2024-09-21T13:45:06.279 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T13:45:06.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T13:45:06.371 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900 branch: reef description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909900' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: client: rbd cache: true rbd cache policy: writearound global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4623 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 80/128 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: a477b1894d5c5a613f23260ca0e6b96d79652ba7 targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxbBaccP8SAp3u1od3vvTde16Yj7+02BEZHsxaJx8ACdojId8jz6RTAoLKEtT32SA+/WNajfU+97qG6fpZDppA= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFInB3dkq3zPXttRllPs7/8IsOSCoUk7YCQHKmFnhktt0v1JRNN0gpDU8OVTbVnfQp4OPlUFhMnr2AjygZRLBmE= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_22:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T13:45:06.372 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa; will attempt to use it 2024-09-21T13:45:06.372 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa/tasks 2024-09-21T13:45:06.372 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T13:45:06.374 INFO:teuthology.task.internal:Checking packages... 2024-09-21T13:45:06.395 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-21T13:45:06.395 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T13:45:06.395 INFO:teuthology.packaging:ref: None 2024-09-21T13:45:06.395 INFO:teuthology.packaging:tag: None 2024-09-21T13:45:06.395 INFO:teuthology.packaging:branch: reef 2024-09-21T13:45:06.395 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T13:45:06.395 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-21T13:45:06.633 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-871-g6a1bdf85-1jammy 2024-09-21T13:45:06.634 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T13:45:06.642 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T13:45:06.642 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T13:45:06.700 INFO:teuthology.task.internal:Saving configuration 2024-09-21T13:45:06.713 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T13:45:06.733 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T13:45:06.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 13:39:32.535850', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDPjTvSAMZynxoCUdfsbfhtYdi4+e+zv0ZQ1PEoH3EqT'} 2024-09-21T13:45:06.783 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 13:39:32.537602', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEwGDb2jQCJV26jmPAOl5AQ4IQdAEi3/BQFRlPC5ryq+'} 2024-09-21T13:45:06.783 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T13:45:06.791 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-21T13:45:06.791 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-21T13:45:06.791 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T13:45:06.891 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ba99ffa30>, signals=[15]) 2024-09-21T13:45:06.891 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T13:45:06.900 INFO:teuthology.task.internal:Opening connections... 2024-09-21T13:45:06.900 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:45:06.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:45:06.983 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:45:06.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:45:07.062 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T13:45:07.070 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-21T13:45:07.075 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-21T13:45:07.075 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-21T13:45:07.119 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T13:45:07.120 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-09-21T13:45:07.121 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-21T13:45:07.150 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-21T13:45:07.155 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-21T13:45:07.155 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="22.04" 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=jammy 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-09-21T13:45:07.203 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-09-21T13:45:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-21T13:45:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-21T13:45:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-21T13:45:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-21T13:45:07.204 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=jammy 2024-09-21T13:45:07.204 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-21T13:45:07.225 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T13:45:07.235 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T13:45:07.285 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T13:45:07.285 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-21T13:45:07.287 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-21T13:45:07.292 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T13:45:07.315 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T13:45:07.315 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-21T13:45:07.333 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-21T13:45:07.340 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T13:45:07.408 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T13:45:07.427 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T13:45:07.428 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T13:45:07.428 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T13:45:07.428 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T13:45:07.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:45:07.433 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-21T13:45:07.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:45:07.434 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-21T13:45:07.479 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-56-generic 2024-09-21T13:45:07.479 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.15.0-56-generic 2024-09-21T13:45:07.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-21T13:45:07.480 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-09-21T13:45:07.480 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-09-21T13:45:07.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-21T13:45:07.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-21T13:45:07.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-21T13:45:07.716 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:45:07.719 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T13:45:07.721 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T13:45:07.762 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:45:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-21T13:45:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T13:45:07.801 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T13:45:07.831 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-21T13:45:07.945 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T13:45:07.997 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-21T13:45:08.015 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T13:45:08.016 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T13:45:08.053 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T13:45:08.055 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T13:45:08.056 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T13:45:08.067 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T13:45:08.068 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-21T13:45:08.075 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T13:45:08.075 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,062 kB] 2024-09-21T13:45:08.076 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T13:45:08.079 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T13:45:08.079 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T13:45:08.085 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T13:45:08.089 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T13:45:08.090 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T13:45:08.105 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-21T13:45:08.110 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T13:45:08.110 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T13:45:08.111 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-21T13:45:08.111 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-21T13:45:08.111 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-21T13:45:08.111 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T13:45:08.112 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T13:45:08.112 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T13:45:08.114 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T13:45:08.114 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T13:45:08.126 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-21T13:45:08.129 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-21T13:45:08.130 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [905 kB] 2024-09-21T13:45:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T13:45:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T13:45:08.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [629 kB] 2024-09-21T13:45:08.138 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T13:45:08.138 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T13:45:08.140 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-21T13:45:08.141 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-21T13:45:08.147 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T13:45:08.153 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T13:45:08.155 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T13:45:08.155 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T13:45:08.155 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T13:45:08.165 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T13:45:08.165 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T13:45:08.165 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T13:45:08.166 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T13:45:08.173 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T13:45:08.174 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T13:45:08.174 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T13:45:08.174 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T13:45:08.174 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T13:45:08.178 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-21T13:45:08.178 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [703 kB] 2024-09-21T13:45:08.178 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-21T13:45:08.179 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-21T13:45:08.179 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-21T13:45:08.182 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T13:45:08.186 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [356 kB] 2024-09-21T13:45:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-21T13:45:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-21T13:45:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,499 kB] 2024-09-21T13:45:08.216 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [430 kB] 2024-09-21T13:45:08.221 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-21T13:45:08.221 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-21T13:45:08.228 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-21T13:45:08.235 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-21T13:45:08.237 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-21T13:45:08.237 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-21T13:45:08.238 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-21T13:45:08.238 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-21T13:45:08.239 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-21T13:45:08.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-21T13:45:08.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-21T13:45:08.256 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-21T13:45:08.256 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-21T13:45:08.256 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-21T13:45:08.257 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-21T13:45:08.257 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-21T13:45:08.257 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-21T13:45:14.417 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 16.3 MB in 2s (7,511 kB/s) 2024-09-21T13:45:14.646 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 16.3 MB in 2s (7,646 kB/s) 2024-09-21T13:45:15.821 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:45:15.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T13:45:15.901 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:45:16.074 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:45:16.089 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-21T13:45:16.089 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-21T13:45:16.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T13:45:16.146 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:45:16.258 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:45:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:45:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:45:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:45:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T13:45:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-09-21T13:45:16.259 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:45:16.260 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-21T13:45:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T13:45:16.261 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T13:45:16.261 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T13:45:16.262 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-21T13:45:16.262 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T13:45:16.262 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-21T13:45:16.262 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-09-21T13:45:16.311 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-21T13:45:16.311 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T13:45:16.311 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T13:45:16.312 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T13:45:16.313 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-21T13:45:16.313 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T13:45:16.332 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-21T13:45:16.333 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-21T13:45:16.362 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T13:45:16.363 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-09-21T13:45:16.363 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T13:45:16.363 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T13:45:16.502 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:45:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:45:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:45:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:45:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-21T13:45:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: python2.7-minimal 2024-09-21T13:45:16.503 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:45:16.504 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-21T13:45:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T13:45:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-21T13:45:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-21T13:45:16.506 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-21T13:45:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-21T13:45:16.506 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-21T13:45:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-09-21T13:45:16.556 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-21T13:45:16.556 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-21T13:45:16.557 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-21T13:45:16.557 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-21T13:45:16.558 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-09-21T13:45:16.559 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-21T13:45:16.609 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T13:45:16.609 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 113 MB of archives. 2024-09-21T13:45:16.609 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-21T13:45:16.609 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-21T13:45:16.801 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T13:45:16.911 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T13:45:17.049 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-21T13:45:17.157 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-21T13:45:17.755 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T13:45:17.756 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T13:45:17.756 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T13:45:17.876 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T13:45:17.898 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T13:45:17.945 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-21T13:45:18.024 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-21T13:45:18.024 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-21T13:45:18.156 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-21T13:45:18.177 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-21T13:45:18.293 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 2s (71.8 MB/s) 2024-09-21T13:45:18.478 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T13:45:18.584 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 113 MB in 2s (70.3 MB/s) 2024-09-21T13:45:18.747 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-21T13:45:20.552 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T13:45:20.556 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:20.617 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:20.674 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-21T13:45:20.678 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:20.743 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:22.760 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T13:45:22.781 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:22.802 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-21T13:45:22.823 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:22.905 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:23.366 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T13:45:23.371 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-21T13:45:23.384 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:23.392 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:23.422 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:23.429 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:29.906 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:30.039 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:30.313 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:30.339 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:30.425 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:30.456 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:30.720 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T13:45:30.742 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T13:45:30.756 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:30.786 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T13:45:30.876 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:31.188 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-21T13:45:31.210 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-21T13:45:31.254 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T13:45:35.960 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T13:45:35.997 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:36.034 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:37.063 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-21T13:45:37.100 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-21T13:45:37.138 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:38.725 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:38.855 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:39.180 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T13:45:39.302 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:39.419 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T13:45:39.548 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:39.695 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-21T13:45:39.823 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-21T13:45:40.167 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-21T13:45:40.286 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:40.387 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-21T13:45:40.491 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:40.876 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:45:40.877 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T13:45:40.877 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:45:40.877 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T13:45:41.075 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:41.800 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:45:41.800 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-21T13:45:41.800 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:45:41.800 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-21T13:45:41.959 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:42.452 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T13:45:42.578 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T13:45:42.703 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:44.160 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-21T13:45:44.270 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-21T13:45:44.371 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:44.623 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:44.691 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T13:45:44.691 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:45:45.789 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-21T13:45:45.846 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-21T13:45:45.847 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:45:59.167 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T13:45:59.167 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-09-21T13:45:59.177 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T13:45:59.194 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-09-21T13:45:59.520 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:45:59.541 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:45:59.868 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:45:59.875 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T13:45:59.945 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T13:45:59.951 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T13:46:00.089 INFO:teuthology.orchestra.run.smithi134.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T13:46:00.089 INFO:teuthology.orchestra.run.smithi134.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T13:46:00.089 INFO:teuthology.orchestra.run.smithi134.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T13:46:00.135 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-09-21T13:46:00.591 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-21T13:46:00.591 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-09-21T13:46:00.615 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T13:46:00.627 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-21T13:46:00.637 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-21T13:46:00.644 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.122.122 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-21T13:46:00.645 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-21T13:46:00.645 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T13:46:00.645 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T13:46:00.645 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T13:46:00.645 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T13:46:00.645 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T13:46:00.646 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-09-21T13:46:00.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-21T13:46:00.909 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:46:00.939 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:46:01.038 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:46:01.054 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T13:46:01.111 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T13:46:01.194 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T13:46:01.246 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:46:01.252 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T13:46:01.318 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T13:46:01.324 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T13:46:01.479 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T13:46:01.480 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T13:46:01.480 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T13:46:01.513 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-21T13:46:01.996 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-21T13:46:02.023 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-21T13:46:02.023 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-21T13:46:02.023 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-21T13:46:02.023 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.122.122 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-21T13:46:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-21T13:46:02.024 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-21T13:46:02.024 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T13:46:02.025 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T13:46:02.025 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T13:46:02.025 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T13:46:02.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-21T13:46:02.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-21T13:46:02.337 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:46:02.340 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T13:46:02.357 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T13:46:02.453 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T13:46:02.513 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:46:02.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T13:46:02.585 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:46:02.774 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-21T13:46:02.774 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-21T13:46:02.943 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T13:46:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T13:46:02.945 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:46:02.984 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T13:46:02.986 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-09-21T13:46:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-09-21T13:46:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-09-21T13:46:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-09-21T13:46:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-09-21T13:46:03.044 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 21 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.15.0.122.122 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-09-21T13:46:03.045 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-09-21T13:46:03.045 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-21T13:46:03.090 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.Je9x7cyGly 2024-09-21T13:46:03.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Je9x7cyGly 2024-09-21T13:46:03.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.Je9x7cyGly 2024-09-21T13:46:03.266 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.Je9x7cyGly is 10KB 2024-09-21T13:46:03.279 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.Je9x7cyGly 2024-09-21T13:46:03.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T13:46:03.337 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:46:03.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T13:46:03.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T13:46:03.409 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T13:46:03.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-09-21T13:46:03.823 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:46:03.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-21T13:46:03.906 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:46:04.118 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-21T13:46:04.119 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-21T13:46:04.300 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-21T13:46:04.300 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:46:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:46:04.300 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:46:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:46:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T13:46:04.301 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T13:46:04.301 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:46:04.342 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 345 not upgraded. 2024-09-21T13:46:04.344 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-21T13:46:04.359 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.122.122 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-21T13:46:04.360 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-21T13:46:04.361 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-21T13:46:04.361 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-21T13:46:04.410 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.UIowWIZviQ 2024-09-21T13:46:04.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UIowWIZviQ 2024-09-21T13:46:04.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.UIowWIZviQ 2024-09-21T13:46:04.589 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.UIowWIZviQ is 10KB 2024-09-21T13:46:04.603 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.UIowWIZviQ 2024-09-21T13:46:04.609 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-21T13:46:04.639 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-09-21T13:46:04.640 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T13:46:04.642 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-21T13:46:04.663 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:46:04.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-21T13:46:04.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-21T13:46:04.731 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-21T13:46:04.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-09-21T13:46:04.902 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:46:04.908 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:46:05.216 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:46:05.221 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T13:46:05.262 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T13:46:05.268 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T13:46:05.394 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T13:46:05.395 INFO:teuthology.orchestra.run.smithi134.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T13:46:05.395 INFO:teuthology.orchestra.run.smithi134.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T13:46:05.406 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-21T13:46:05.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-21T13:46:05.976 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-09-21T13:46:05.980 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-21T13:46:05.982 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-21T13:46:06.141 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-21T13:46:06.147 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-21T13:46:06.378 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-21T13:46:06.383 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-21T13:46:06.421 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-21T13:46:06.427 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-21T13:46:06.562 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-21T13:46:06.562 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-21T13:46:06.562 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-21T13:46:06.574 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-21T13:46:06.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-21T13:46:35.439 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T13:46:35.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:46:35.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:46:36.593 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T13:46:36.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:46:36.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:46:53.807 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-21T13:46:55.086 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-21T13:47:02.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:47:02.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:47:04.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:47:04.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:47:05.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-21T13:47:07.151 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-21T13:47:17.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:47:17.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:47:19.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:47:19.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:47:37.583 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-21T13:47:49.686 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-21T13:47:50.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:47:50.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-21T13:47:50.266 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-21T13:47:50.312 INFO:teuthology.orchestra.run.smithi134.stdout:5.15.0-122-generic 2024-09-21T13:47:50.312 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T13:47:50.312 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T13:47:50.312 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T13:47:51.313 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T13:47:51.313 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T13:47:51.671 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-21T13:47:51.693 DEBUG:teuthology.parallel:result is None 2024-09-21T13:47:52.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:47:52.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:47:52.849 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-21T13:47:53.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:47:53.954 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-21T13:47:53.954 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-21T13:47:53.959 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-122-generic 2024-09-21T13:47:53.959 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-21T13:47:53.959 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T13:47:53.959 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-21T13:47:54.960 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T13:47:54.960 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T13:47:55.030 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-21T13:47:55.058 DEBUG:teuthology.parallel:result is None 2024-09-21T13:47:55.058 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T13:47:55.068 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T13:47:55.068 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T13:47:55.071 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T13:47:55.078 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T13:47:55.085 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T13:47:55.094 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T13:47:55.094 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T13:47:55.119 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T13:47:55.227 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T13:47:55.235 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T13:47:55.235 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T13:47:55.238 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T13:47:55.268 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:47:55.277 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:47:55.283 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:47:55.292 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T13:47:55.294 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T13:47:55.314 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T13:47:55.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T13:47:55.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T13:47:55.338 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T13:47:55.347 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T13:47:55.347 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T13:47:55.381 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T13:47:55.387 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:47:55.433 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:47:55.481 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:47:55.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T13:47:55.548 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T13:47:55.554 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T13:47:55.604 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:47:55.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T13:47:55.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-21T13:47:55.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-21T13:47:55.741 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T13:47:55.749 INFO:teuthology.task.internal:Starting timer... 2024-09-21T13:47:55.749 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T13:47:55.759 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T13:47:55.770 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-09-21T13:47:55.771 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-09-21T13:47:55.771 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T13:47:55.771 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-21T13:47:55.771 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T13:47:55.772 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T13:47:55.780 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T13:47:55.791 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T13:47:55.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T13:55:24.457 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-09-21T13:55:24.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:55:24.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:55:24.537 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-21T13:55:24.614 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T13:55:24.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:55:24.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T13:55:24.694 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-21T13:55:24.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-21T13:55:24.771 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T13:55:24.786 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T13:55:24.786 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T13:55:24.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:55:24.789 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T13:55:24.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:55:24.815 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Command line: ntpd -gq 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: ---------------------------------------------------- 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: corporation. Support and training for ntp-4 are 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: available at https://www.nwtime.org/support 2024-09-21T13:55:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: ---------------------------------------------------- 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: proto: precision = 0.044 usec (-24) 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: basedate set to 2022-02-04 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: gps base set to 2022-02-06 (week 2196) 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T13:55:24.817 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T13:55:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T13:55:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T13:55:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T13:55:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T13:55:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-09-21T13:55:24.819 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen normally on 4 lo [::1]:123 2024-09-21T13:55:24.819 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-09-21T13:55:24.819 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:24 ntpd[18466]: Listening on routing socket on fd #22 for interface updates 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Command line: ntpd -gq 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: ---------------------------------------------------- 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: ntp-4 is maintained by Network Time Foundation, 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: corporation. Support and training for ntp-4 are 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: available at https://www.nwtime.org/support 2024-09-21T13:55:24.840 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: ---------------------------------------------------- 2024-09-21T13:55:24.841 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: proto: precision = 0.044 usec (-24) 2024-09-21T13:55:24.841 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: basedate set to 2022-02-04 2024-09-21T13:55:24.841 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: gps base set to 2022-02-06 (week 2196) 2024-09-21T13:55:24.841 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T13:55:24.842 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-21T13:55:24.842 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: restrict ::: KOD does nothing without LIMITED. 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen and drop on 0 v6wildcard [::]:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen normally on 2 lo 127.0.0.1:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen normally on 4 lo [::1]:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-09-21T13:55:24.843 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:24 ntpd[18461]: Listening on routing socket on fd #22 for interface updates 2024-09-21T13:55:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:25.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:25.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:25 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:25.840 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:25.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:25 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:26 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:27 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:27.841 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:27.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:27.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:27.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:27 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:28.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:28.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:28 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:29.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:29.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:29 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:29.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:29 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:30.816 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:30.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:30 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.817 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stdout:21 Sep 13:55:31 ntpd[18466]: ntpd: time slew -0.003846 s 2024-09-21T13:55:31.818 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew -0.003846s 2024-09-21T13:55:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T13:55:31.819 INFO:teuthology.orchestra.run.smithi079.stderr:21 Sep 13:55:31 ntpd[18466]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.842 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/rawstats.20240921: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-21T13:55:31.843 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/peerstats.20240921: Permission denied 2024-09-21T13:55:31.844 INFO:teuthology.orchestra.run.smithi134.stdout:21 Sep 13:55:31 ntpd[18461]: ntpd: time slew -0.002275 s 2024-09-21T13:55:31.844 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew -0.002275s 2024-09-21T13:55:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-21T13:55:31.844 INFO:teuthology.orchestra.run.smithi134.stderr:21 Sep 13:55:31 ntpd[18461]: can't open /var/log/ntpstats/loopstats.20240921: Permission denied 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.876 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.899 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T13:55:31.899 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-21T13:55:31.899 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.900 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.900 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.900 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T13:55:31.900 INFO:teuthology.run_tasks:Running task install... 2024-09-21T13:55:31.909 DEBUG:teuthology.task.install:project ceph 2024-09-21T13:55:31.910 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}} 2024-09-21T13:55:31.910 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-21T13:55:31.910 INFO:teuthology.task.install:Using flavor: default 2024-09-21T13:55:31.916 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T13:55:31.916 INFO:teuthology.task.install:extra packages: [] 2024-09-21T13:55:31.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-09-21T13:55:31.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-09-21T13:55:31.974 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T13:55:31.995 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-21T13:55:32.002 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T13:55:32.002 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T13:55:32.002 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-21T13:55:32.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T13:55:32.021 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-21T13:55:32.021 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-09-21T13:55:32.021 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-21T13:55:32.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T13:55:32.147 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-21T13:55:32.147 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:55:32.162 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default/ 2024-09-21T13:55:32.163 INFO:teuthology.task.install.deb:Package version is 18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:55:32.383 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:55:32.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T13:55:32.390 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:55:32.390 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-21T13:55:32.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-21T13:55:32.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-09-21T13:55:32.562 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-21T13:55:32.689 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T13:55:32.690 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy InRelease 2024-09-21T13:55:32.691 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:55:32.700 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-21T13:55:32.700 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-21T13:55:32.711 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-21T13:55:32.711 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-21T13:55:32.733 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T13:55:32.734 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-21T13:55:32.754 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-21T13:55:32.755 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-21T13:55:32.772 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T13:55:32.772 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-21T13:55:32.781 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,437 B] 2024-09-21T13:55:32.782 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-21T13:55:32.853 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T13:55:32.854 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-21T13:55:33.012 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 158 kB in 0s (366 kB/s) 2024-09-21T13:55:33.059 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 28.8 kB in 0s (60.2 kB/s) 2024-09-21T13:55:34.053 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:55:34.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:55:34.078 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:55:34.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-855-g19e2a2be-1jammy cephadm=18.2.4-855-g19e2a2be-1jammy ceph-mds=18.2.4-855-g19e2a2be-1jammy ceph-mgr=18.2.4-855-g19e2a2be-1jammy ceph-common=18.2.4-855-g19e2a2be-1jammy ceph-fuse=18.2.4-855-g19e2a2be-1jammy ceph-test=18.2.4-855-g19e2a2be-1jammy ceph-volume=18.2.4-855-g19e2a2be-1jammy radosgw=18.2.4-855-g19e2a2be-1jammy python3-rados=18.2.4-855-g19e2a2be-1jammy python3-rgw=18.2.4-855-g19e2a2be-1jammy python3-cephfs=18.2.4-855-g19e2a2be-1jammy python3-rbd=18.2.4-855-g19e2a2be-1jammy libcephfs2=18.2.4-855-g19e2a2be-1jammy libcephfs-dev=18.2.4-855-g19e2a2be-1jammy librados2=18.2.4-855-g19e2a2be-1jammy librbd1=18.2.4-855-g19e2a2be-1jammy rbd-fuse=18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:55:34.135 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-21T13:55:34.149 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-09-21T13:55:34.336 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-09-21T13:55:34.337 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-09-21T13:55:34.348 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-21T13:55:34.349 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-21T13:55:34.525 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:55:34.525 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:55:34.525 INFO:teuthology.orchestra.run.smithi134.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:55:34.525 INFO:teuthology.orchestra.run.smithi134.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:55:34.525 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T13:55:34.526 INFO:teuthology.orchestra.run.smithi134.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T13:55:34.526 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:55:34.526 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-09-21T13:55:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T13:55:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T13:55:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-21T13:55:34.527 INFO:teuthology.orchestra.run.smithi134.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T13:55:34.528 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-09-21T13:55:34.529 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: python3-watchdog 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-09-21T13:55:34.530 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-09-21T13:55:34.557 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-21T13:55:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-21T13:55:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-21T13:55:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-21T13:55:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-21T13:55:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-21T13:55:34.559 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-21T13:55:34.559 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-21T13:55:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-21T13:55:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-21T13:55:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-21T13:55:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-21T13:55:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-21T13:55:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-21T13:55:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-21T13:55:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-21T13:55:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: python3-watchdog 2024-09-21T13:55:34.563 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-21T13:55:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-21T13:55:34.630 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-21T13:55:34.631 INFO:teuthology.orchestra.run.smithi134.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-21T13:55:34.632 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-21T13:55:34.633 INFO:teuthology.orchestra.run.smithi134.stdout: socat xmlstarlet 2024-09-21T13:55:34.665 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-21T13:55:34.666 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-21T13:55:34.667 INFO:teuthology.orchestra.run.smithi079.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-21T13:55:34.667 INFO:teuthology.orchestra.run.smithi079.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-21T13:55:34.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-21T13:55:34.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-21T13:55:34.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-21T13:55:34.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-21T13:55:34.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-21T13:55:34.669 INFO:teuthology.orchestra.run.smithi079.stdout: socat xmlstarlet 2024-09-21T13:55:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 109 newly installed, 0 to remove and 332 not upgraded. 2024-09-21T13:55:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 163 MB of archives. 2024-09-21T13:55:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-21T13:55:34.774 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-21T13:55:34.808 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 109 newly installed, 0 to remove and 332 not upgraded. 2024-09-21T13:55:34.808 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 163 MB of archives. 2024-09-21T13:55:34.809 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-21T13:55:34.809 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-855-g19e2a2be-1jammy [3,452 kB] 2024-09-21T13:55:34.819 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-21T13:55:34.854 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-21T13:55:34.954 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-21T13:55:35.017 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-21T13:55:35.028 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-21T13:55:35.033 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-21T13:55:35.034 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-21T13:55:35.036 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-21T13:55:35.038 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-21T13:55:35.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-21T13:55:35.044 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-855-g19e2a2be-1jammy [3,108 kB] 2024-09-21T13:55:35.102 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T13:55:35.136 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-21T13:55:35.199 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-855-g19e2a2be-1jammy [683 kB] 2024-09-21T13:55:35.212 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-855-g19e2a2be-1jammy [357 kB] 2024-09-21T13:55:35.219 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-855-g19e2a2be-1jammy [32.8 kB] 2024-09-21T13:55:35.220 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-855-g19e2a2be-1jammy [180 kB] 2024-09-21T13:55:35.224 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-855-g19e2a2be-1jammy [63.8 kB] 2024-09-21T13:55:35.225 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-855-g19e2a2be-1jammy [334 kB] 2024-09-21T13:55:35.233 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-855-g19e2a2be-1jammy [5,934 kB] 2024-09-21T13:55:35.262 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-21T13:55:35.264 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-21T13:55:35.279 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T13:55:35.293 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T13:55:35.296 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-21T13:55:35.308 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-21T13:55:35.321 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-21T13:55:35.360 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-855-g19e2a2be-1jammy [112 kB] 2024-09-21T13:55:35.362 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-855-g19e2a2be-1jammy [445 kB] 2024-09-21T13:55:35.365 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T13:55:35.369 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-855-g19e2a2be-1jammy [22.0 MB] 2024-09-21T13:55:35.394 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-21T13:55:35.560 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T13:55:35.570 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T13:55:35.588 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-21T13:55:35.597 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T13:55:35.598 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-21T13:55:35.605 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T13:55:35.606 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T13:55:35.608 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T13:55:35.625 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-21T13:55:35.626 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T13:55:35.628 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T13:55:35.629 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T13:55:35.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-21T13:55:35.634 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-21T13:55:35.636 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-21T13:55:35.643 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T13:55:35.654 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-21T13:55:35.655 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-21T13:55:35.656 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-21T13:55:35.670 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-21T13:55:35.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T13:55:35.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T13:55:35.714 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T13:55:35.715 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T13:55:35.716 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T13:55:35.717 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T13:55:35.722 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T13:55:35.725 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T13:55:35.726 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T13:55:35.740 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-21T13:55:35.741 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-21T13:55:35.741 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-21T13:55:35.742 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-21T13:55:35.743 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-21T13:55:35.744 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-21T13:55:35.752 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-21T13:55:35.753 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-21T13:55:35.754 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-21T13:55:35.806 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T13:55:35.808 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T13:55:35.809 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T13:55:35.810 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T13:55:35.812 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T13:55:35.814 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T13:55:35.815 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T13:55:35.832 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-21T13:55:35.834 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-21T13:55:35.834 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-21T13:55:35.835 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-21T13:55:35.837 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-21T13:55:35.839 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-21T13:55:35.887 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T13:55:35.888 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T13:55:35.889 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T13:55:35.913 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-21T13:55:35.923 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-21T13:55:35.924 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-21T13:55:35.925 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-21T13:55:35.969 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T13:55:35.971 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T13:55:35.975 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T13:55:35.977 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T13:55:35.980 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T13:55:35.982 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T13:55:35.986 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T13:55:35.994 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-21T13:55:36.050 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T13:55:36.052 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T13:55:36.057 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T13:55:36.058 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-21T13:55:36.060 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-21T13:55:36.062 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-21T13:55:36.063 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-21T13:55:36.066 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-21T13:55:36.112 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-21T13:55:36.116 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-21T13:55:36.118 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-21T13:55:36.119 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-21T13:55:36.124 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-21T13:55:36.173 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-21T13:55:36.178 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-21T13:55:36.180 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-21T13:55:36.198 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-855-g19e2a2be-1jammy [5,006 kB] 2024-09-21T13:55:36.219 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T13:55:36.221 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T13:55:36.223 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T13:55:36.226 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-21T13:55:36.256 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-21T13:55:36.275 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T13:55:36.276 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-21T13:55:36.277 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T13:55:36.277 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T13:55:36.278 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T13:55:36.279 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-21T13:55:36.279 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-21T13:55:36.281 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-21T13:55:36.282 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-21T13:55:36.283 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-21T13:55:36.283 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T13:55:36.283 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T13:55:36.287 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-21T13:55:36.287 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-21T13:55:36.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T13:55:36.322 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-855-g19e2a2be-1jammy [241 kB] 2024-09-21T13:55:36.327 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-855-g19e2a2be-1jammy [130 kB] 2024-09-21T13:55:36.330 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-855-g19e2a2be-1jammy [1,494 kB] 2024-09-21T13:55:36.338 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-21T13:55:36.367 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T13:55:36.371 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T13:55:36.371 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T13:55:36.377 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-21T13:55:36.380 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-21T13:55:36.381 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-21T13:55:36.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-855-g19e2a2be-1jammy [6,085 kB] 2024-09-21T13:55:36.402 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-21T13:55:36.408 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T13:55:36.416 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T13:55:36.419 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T13:55:36.422 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T13:55:36.425 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T13:55:36.428 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T13:55:36.437 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-21T13:55:36.437 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-21T13:55:36.438 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-21T13:55:36.439 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-21T13:55:36.440 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-21T13:55:36.441 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-21T13:55:36.466 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T13:55:36.469 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T13:55:36.497 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T13:55:36.501 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-21T13:55:36.502 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-21T13:55:36.508 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-21T13:55:36.548 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T13:55:36.551 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T13:55:36.553 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T13:55:36.561 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T13:55:36.567 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T13:55:36.578 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T13:55:36.582 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-21T13:55:36.585 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T13:55:36.585 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-21T13:55:36.587 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-21T13:55:36.595 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-21T13:55:36.601 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-21T13:55:36.610 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-21T13:55:36.612 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-855-g19e2a2be-1jammy [22.4 MB] 2024-09-21T13:55:36.617 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-21T13:55:36.629 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T13:55:36.633 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T13:55:36.648 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T13:55:36.663 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-21T13:55:36.667 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-21T13:55:36.683 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-21T13:55:36.710 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T13:55:36.712 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T13:55:36.745 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-21T13:55:36.746 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-21T13:55:37.150 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-21T13:55:37.150 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-21T13:55:37.162 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-21T13:55:37.193 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-21T13:55:37.196 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-21T13:55:37.198 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-21T13:55:37.255 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-21T13:55:37.504 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-855-g19e2a2be-1jammy [14.2 kB] 2024-09-21T13:55:37.504 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-855-g19e2a2be-1jammy [835 kB] 2024-09-21T13:55:37.521 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-855-g19e2a2be-1jammy [2,159 kB] 2024-09-21T13:55:37.532 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-21T13:55:37.533 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-21T13:55:37.558 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-855-g19e2a2be-1jammy [240 kB] 2024-09-21T13:55:37.562 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-855-g19e2a2be-1jammy [145 kB] 2024-09-21T13:55:37.564 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-855-g19e2a2be-1jammy [2,233 kB] 2024-09-21T13:55:37.627 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-855-g19e2a2be-1jammy [8,625 kB] 2024-09-21T13:55:37.936 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-855-g19e2a2be-1jammy [14.3 kB] 2024-09-21T13:55:37.937 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-855-g19e2a2be-1jammy [42.8 MB] 2024-09-21T13:55:39.062 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-21T13:55:39.066 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-21T13:55:39.066 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-21T13:55:39.358 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-21T13:55:39.447 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-855-g19e2a2be-1jammy [122 kB] 2024-09-21T13:55:39.449 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-855-g19e2a2be-1jammy [38.3 kB] 2024-09-21T13:55:39.451 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-855-g19e2a2be-1jammy [11.7 MB] 2024-09-21T13:55:39.680 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-855-g19e2a2be-1jammy [93.1 kB] 2024-09-21T13:55:39.928 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 163 MB in 5s (34.7 MB/s) 2024-09-21T13:55:40.064 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-21T13:55:40.151 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-21T13:55:40.156 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-21T13:55:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-21T13:55:40.273 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 163 MB in 5s (32.2 MB/s) 2024-09-21T13:55:40.413 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-21T13:55:40.505 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-21T13:55:40.511 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-21T13:55:40.595 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-21T13:55:40.607 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T13:55:40.634 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T13:55:40.674 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T13:55:40.914 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-21T13:55:40.941 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-21T13:55:40.981 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T13:55:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T13:55:41.053 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T13:55:41.094 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T13:55:41.359 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-21T13:55:41.385 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-21T13:55:41.426 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T13:55:41.455 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T13:55:41.481 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T13:55:41.522 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T13:55:41.712 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-21T13:55:41.727 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-21T13:55:41.770 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T13:55:41.900 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T13:55:41.927 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:41.975 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:42.224 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-21T13:55:42.251 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:42.298 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:42.395 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T13:55:42.422 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:42.462 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:42.702 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-21T13:55:42.728 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:42.768 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:42.806 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T13:55:42.833 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:42.873 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:43.063 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-21T13:55:43.089 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-21T13:55:43.130 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:55:43.201 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T13:55:43.228 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T13:55:43.268 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T13:55:43.475 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-21T13:55:43.501 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-21T13:55:43.541 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T13:55:43.596 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-09-21T13:55:43.622 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:43.662 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:43.860 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librados2. 2024-09-21T13:55:43.887 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-librados2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:43.927 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:44.132 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-09-21T13:55:44.158 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:44.198 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:44.338 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librbd1. 2024-09-21T13:55:44.353 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-librbd1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:44.388 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:44.601 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T13:55:44.627 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:44.659 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:44.816 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-09-21T13:55:44.842 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:44.920 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-09-21T13:55:44.924 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:44.946 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:44.987 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:45.210 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-09-21T13:55:45.236 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-rados_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:45.276 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:45.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T13:55:45.374 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:55:45.414 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:45.563 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-21T13:55:45.589 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:55:45.638 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:45.667 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T13:55:45.694 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:45.734 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:45.848 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-09-21T13:55:45.863 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:45.898 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:46.011 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T13:55:46.037 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:55:46.070 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:46.226 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-21T13:55:46.252 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:55:46.292 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:46.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T13:55:46.374 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T13:55:46.406 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T13:55:46.621 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-21T13:55:46.646 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-21T13:55:46.687 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T13:55:46.734 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T13:55:46.760 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T13:55:46.800 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T13:55:46.982 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-09-21T13:55:47.008 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-21T13:55:47.048 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-21T13:55:47.070 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T13:55:47.085 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:47.128 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:47.268 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-09-21T13:55:47.294 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:47.334 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:47.448 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T13:55:47.474 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T13:55:47.514 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T13:55:47.687 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-21T13:55:47.713 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-21T13:55:47.753 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T13:55:47.817 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-09-21T13:55:47.843 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:47.892 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:48.082 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-09-21T13:55:48.108 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librgw2_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:48.148 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:48.486 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T13:55:48.501 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:48.544 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:48.650 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-09-21T13:55:48.666 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:48.700 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:48.881 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T13:55:48.904 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T13:55:48.964 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T13:55:48.995 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-21T13:55:49.021 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-21T13:55:49.061 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T13:55:49.283 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T13:55:49.310 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:49.350 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:49.381 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-09-21T13:55:49.407 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:49.447 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:49.728 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-09-21T13:55:49.754 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:49.795 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:49.876 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-09-21T13:55:49.902 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-ceph-common_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:49.942 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:51.076 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-09-21T13:55:51.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:51.152 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:51.215 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-09-21T13:55:51.240 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-ceph-base_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:55:51.291 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:55:51.730 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T13:55:51.756 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T13:55:51.796 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T13:55:52.083 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T13:55:52.109 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T13:55:52.127 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-21T13:55:52.141 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T13:55:52.153 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-21T13:55:52.193 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-21T13:55:52.436 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T13:55:52.462 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T13:55:52.471 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cheroot. 2024-09-21T13:55:52.493 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T13:55:52.498 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-21T13:55:52.538 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T13:55:52.821 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T13:55:52.847 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T13:55:52.858 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-21T13:55:52.884 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-21T13:55:52.888 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T13:55:52.924 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-21T13:55:53.199 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T13:55:53.225 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T13:55:53.227 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-21T13:55:53.253 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-21T13:55:53.266 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T13:55:53.293 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-21T13:55:53.577 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T13:55:53.596 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-21T13:55:53.600 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T13:55:53.611 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-21T13:55:53.635 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T13:55:53.646 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-21T13:55:53.899 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempora. 2024-09-21T13:55:53.905 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-09-21T13:55:53.926 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-21T13:55:53.931 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-21T13:55:53.966 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-21T13:55:53.971 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T13:55:54.252 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-portend. 2024-09-21T13:55:54.266 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T13:55:54.278 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-21T13:55:54.292 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T13:55:54.318 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-21T13:55:54.332 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T13:55:54.613 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-21T13:55:54.636 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T13:55:54.639 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-21T13:55:54.662 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T13:55:54.688 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-21T13:55:54.702 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T13:55:54.932 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-21T13:55:54.958 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-21T13:55:54.990 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-21T13:55:55.039 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T13:55:55.065 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T13:55:55.105 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T13:55:55.327 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-09-21T13:55:55.354 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-21T13:55:55.402 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-21T13:55:55.445 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T13:55:55.471 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T13:55:55.511 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T13:55:55.730 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-09-21T13:55:55.756 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-21T13:55:55.797 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-21T13:55:55.805 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T13:55:55.832 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T13:55:55.872 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T13:55:56.041 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-21T13:55:56.060 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-21T13:55:56.091 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-21T13:55:56.134 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-09-21T13:55:56.160 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T13:55:56.209 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T13:55:56.394 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-09-21T13:55:56.420 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-21T13:55:56.460 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T13:55:56.529 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T13:55:56.555 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T13:55:56.595 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T13:55:56.797 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-21T13:55:56.823 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-21T13:55:56.864 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-21T13:55:56.915 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T13:55:56.941 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T13:55:56.982 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T13:55:57.191 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-21T13:55:57.218 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-21T13:55:57.258 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-21T13:55:57.277 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-09-21T13:55:57.303 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T13:55:57.335 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T13:55:57.502 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-09-21T13:55:57.518 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-21T13:55:57.552 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T13:55:57.646 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T13:55:57.673 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T13:55:57.716 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T13:55:57.889 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-09-21T13:55:57.915 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-21T13:55:57.959 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T13:55:58.025 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T13:55:58.041 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T13:55:58.083 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T13:55:58.266 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-09-21T13:55:58.293 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-21T13:55:58.333 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T13:55:58.394 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-09-21T13:55:58.421 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T13:55:58.461 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T13:55:58.636 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-09-21T13:55:58.663 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-21T13:55:58.702 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T13:55:58.798 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T13:55:58.824 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T13:55:58.864 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T13:55:59.014 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-21T13:55:59.029 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-21T13:55:59.072 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T13:55:59.168 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T13:55:59.194 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T13:55:59.234 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T13:55:59.392 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-21T13:55:59.418 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-21T13:55:59.458 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-21T13:55:59.512 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T13:55:59.538 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T13:55:59.579 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T13:55:59.761 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-09-21T13:55:59.788 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-21T13:55:59.827 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-21T13:55:59.849 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T13:55:59.875 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T13:55:59.915 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T13:56:00.147 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-09-21T13:56:00.174 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-21T13:56:00.214 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T13:56:00.246 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T13:56:00.272 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T13:56:00.312 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T13:56:00.552 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-certifi. 2024-09-21T13:56:00.578 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-21T13:56:00.618 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-21T13:56:00.665 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-09-21T13:56:00.691 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T13:56:00.732 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T13:56:00.913 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-idna. 2024-09-21T13:56:00.939 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-21T13:56:00.979 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T13:56:01.060 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T13:56:01.087 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T13:56:01.127 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T13:56:01.315 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-urllib3. 2024-09-21T13:56:01.342 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-21T13:56:01.382 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T13:56:01.472 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-09-21T13:56:01.498 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T13:56:01.539 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T13:56:01.693 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests. 2024-09-21T13:56:01.720 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-21T13:56:01.760 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T13:56:01.808 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T13:56:01.835 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T13:56:01.866 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T13:56:02.071 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-21T13:56:02.097 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-21T13:56:02.137 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T13:56:02.178 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T13:56:02.193 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:02.236 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:02.424 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-21T13:56:02.448 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:02.491 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:02.642 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T13:56:02.668 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:02.708 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:02.912 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-21T13:56:02.939 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:02.978 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:03.037 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T13:56:03.063 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T13:56:03.103 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T13:56:03.298 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-21T13:56:03.325 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-21T13:56:03.365 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-21T13:56:03.406 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T13:56:03.433 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T13:56:03.464 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T13:56:03.634 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-09-21T13:56:03.650 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-21T13:56:03.684 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-21T13:56:03.978 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T13:56:04.005 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:04.010 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-09-21T13:56:04.036 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:04.045 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:04.076 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:04.448 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T13:56:04.475 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:04.480 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-09-21T13:56:04.506 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:04.514 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:04.546 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:05.110 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T13:56:05.125 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-09-21T13:56:05.137 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:05.152 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:05.176 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:05.183 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:06.205 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-09-21T13:56:06.220 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:06.254 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:06.320 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-09-21T13:56:06.337 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-ceph_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:06.378 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:06.557 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T13:56:06.584 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:06.624 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:06.698 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-09-21T13:56:06.725 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:06.765 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:06.986 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T13:56:07.012 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:07.053 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:07.102 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-09-21T13:56:07.128 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:07.160 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:07.547 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-09-21T13:56:07.573 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:07.613 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:07.622 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-09-21T13:56:07.644 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-cephadm_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:08.213 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:08.659 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T13:56:08.685 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T13:56:08.725 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T13:56:08.825 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-21T13:56:08.852 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-21T13:56:08.892 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-21T13:56:09.027 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T13:56:09.043 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T13:56:09.086 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:09.229 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-21T13:56:09.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T13:56:09.295 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:10.149 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-babel. 2024-09-21T13:56:10.176 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T13:56:10.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:10.376 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-09-21T13:56:10.403 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-21T13:56:10.442 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:10.535 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T13:56:10.562 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T13:56:10.602 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T13:56:10.779 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-09-21T13:56:10.806 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-21T13:56:10.846 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T13:56:10.947 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T13:56:10.962 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:10.996 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:11.182 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-21T13:56:11.209 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:11.249 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:11.283 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T13:56:11.299 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T13:56:11.333 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T13:56:11.603 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-09-21T13:56:11.620 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-09-21T13:56:11.629 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-21T13:56:11.647 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-21T13:56:11.669 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T13:56:11.686 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-21T13:56:11.956 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-09-21T13:56:11.983 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-21T13:56:11.992 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T13:56:12.014 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-21T13:56:12.018 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T13:56:12.058 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T13:56:12.310 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-21T13:56:12.337 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-21T13:56:12.352 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-toml. 2024-09-21T13:56:12.376 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-21T13:56:12.379 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-21T13:56:12.419 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T13:56:12.672 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T13:56:12.680 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-09-21T13:56:12.699 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T13:56:12.707 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-21T13:56:12.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T13:56:12.746 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-21T13:56:13.049 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-09-21T13:56:13.059 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T13:56:13.076 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-21T13:56:13.086 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T13:56:13.116 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T13:56:13.125 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T13:56:13.395 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-09-21T13:56:13.422 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T13:56:13.462 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T13:56:13.462 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-21T13:56:13.488 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-21T13:56:13.528 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-21T13:56:13.815 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T13:56:13.830 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:13.848 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-09-21T13:56:13.865 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-21T13:56:13.915 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T13:56:14.435 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-21T13:56:14.462 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:14.493 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:15.071 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T13:56:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T13:56:15.137 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T13:56:15.658 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T13:56:15.685 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T13:56:15.732 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T13:56:15.757 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-21T13:56:15.782 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-21T13:56:15.849 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T13:56:16.086 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T13:56:16.114 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T13:56:16.145 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T13:56:16.353 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-09-21T13:56:16.380 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-21T13:56:16.411 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T13:56:16.414 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T13:56:16.441 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T13:56:16.480 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T13:56:16.774 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-21T13:56:16.800 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-21T13:56:16.840 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-21T13:56:17.152 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-09-21T13:56:17.179 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-21T13:56:17.206 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T13:56:17.218 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T13:56:17.233 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:17.928 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-21T13:56:17.955 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:17.994 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:18.392 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T13:56:18.419 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T13:56:18.467 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T13:56:18.897 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T13:56:18.924 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T13:56:18.963 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T13:56:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-09-21T13:56:19.041 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-21T13:56:19.080 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-21T13:56:19.292 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T13:56:19.319 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T13:56:19.358 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T13:56:19.594 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-21T13:56:19.621 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-21T13:56:19.653 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T13:56:19.680 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-21T13:56:19.680 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-21T13:56:19.719 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T13:56:20.031 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-21T13:56:20.058 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-21T13:56:20.082 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T13:56:20.097 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T13:56:20.109 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T13:56:20.157 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T13:56:20.409 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-09-21T13:56:20.436 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-21T13:56:20.484 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-21T13:56:20.527 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T13:56:20.554 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T13:56:20.593 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T13:56:20.780 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-09-21T13:56:20.807 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-21T13:56:20.846 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-21T13:56:20.922 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T13:56:20.949 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T13:56:20.988 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T13:56:21.158 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-21T13:56:21.185 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-21T13:56:21.216 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T13:56:21.308 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T13:56:21.335 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T13:56:21.374 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T13:56:21.528 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-09-21T13:56:21.555 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-21T13:56:21.594 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-21T13:56:21.915 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-21T13:56:21.942 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-21T13:56:21.981 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T13:56:22.058 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T13:56:22.072 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:22.113 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:22.433 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T13:56:22.460 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T13:56:22.508 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T13:56:22.637 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-21T13:56:22.654 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:22.786 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T13:56:22.814 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T13:56:22.852 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T13:56:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-21T13:56:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-21T13:56:23.113 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-09-21T13:56:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T13:56:23.130 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T13:56:23.172 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T13:56:23.425 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-09-21T13:56:23.452 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T13:56:23.491 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T13:56:23.552 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-21T13:56:23.579 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T13:56:23.618 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T13:56:23.803 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T13:56:23.819 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T13:56:23.861 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T13:56:23.880 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-09-21T13:56:23.907 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-21T13:56:23.946 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-21T13:56:24.224 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-09-21T13:56:24.240 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:24.250 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-09-21T13:56:24.277 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-21T13:56:24.298 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:24.324 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-21T13:56:24.695 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-09-21T13:56:24.722 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-21T13:56:24.769 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-21T13:56:25.183 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-09-21T13:56:25.210 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-ceph-test_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:25.257 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:26.187 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T13:56:26.214 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:26.253 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:26.507 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T13:56:26.522 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:26.565 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:26.944 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T13:56:26.971 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T13:56:27.010 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T13:56:27.170 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-09-21T13:56:27.197 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-855-g19e2a2be-1jammy_all.deb ... 2024-09-21T13:56:27.236 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:27.356 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T13:56:27.372 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T13:56:27.414 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T13:56:27.591 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-21T13:56:27.606 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:27.649 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:27.835 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T13:56:27.862 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T13:56:27.918 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T13:56:28.069 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-09-21T13:56:28.097 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-21T13:56:28.144 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T13:56:28.238 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T13:56:28.265 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T13:56:28.304 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T13:56:28.491 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-21T13:56:28.507 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-21T13:56:28.549 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-21T13:56:28.649 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T13:56:28.677 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T13:56:28.715 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T13:56:28.995 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-09-21T13:56:29.023 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-21T13:56:29.061 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-21T13:56:29.238 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T13:56:29.265 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T13:56:29.336 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T13:56:29.605 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T13:56:29.621 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T13:56:29.655 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T13:56:29.686 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-09-21T13:56:29.714 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-21T13:56:29.907 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-21T13:56:29.908 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T13:56:29.932 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T13:56:29.966 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T13:56:30.235 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-09-21T13:56:30.262 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-21T13:56:30.293 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T13:56:30.637 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-09-21T13:56:30.666 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:30.695 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:30.806 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-21T13:56:30.834 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-21T13:56:30.881 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-21T13:56:31.278 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-09-21T13:56:31.303 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-21T13:56:31.351 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-21T13:56:31.431 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T13:56:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:31.506 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:31.670 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-21T13:56:31.695 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-21T13:56:31.745 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-21T13:56:31.802 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T13:56:32.061 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T13:56:32.187 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T13:56:32.446 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T13:56:32.458 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-09-21T13:56:32.486 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-radosgw_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:32.524 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:32.754 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T13:56:33.182 INFO:teuthology.orchestra.run.smithi134.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T13:56:33.256 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:33.328 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-09-21T13:56:33.355 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-855-g19e2a2be-1jammy_amd64.deb ... 2024-09-21T13:56:33.402 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:33.740 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-21T13:56:34.000 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-21T13:56:34.080 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-09-21T13:56:34.143 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-21T13:56:34.229 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T13:56:34.430 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-21T13:56:34.505 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T13:56:34.748 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T13:56:34.755 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-21T13:56:34.849 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T13:56:35.109 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T13:56:35.154 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-21T13:56:35.219 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:35.362 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T13:56:35.486 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T13:56:35.744 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-09-21T13:56:35.804 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T13:56:35.935 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-21T13:56:36.165 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T13:56:36.219 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-21T13:56:36.407 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T13:56:36.479 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-21T13:56:36.605 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-21T13:56:36.692 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T13:56:36.873 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-21T13:56:36.943 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T13:56:37.133 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-21T13:56:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T13:56:37.253 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-21T13:56:37.462 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:37.546 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-21T13:56:37.738 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T13:56:37.856 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T13:56:37.906 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-21T13:56:38.090 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T13:56:38.157 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-21T13:56:38.216 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T13:56:38.442 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-21T13:56:38.576 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:38.702 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T13:56:38.702 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-21T13:56:38.953 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T13:56:38.987 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-21T13:56:39.212 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T13:56:39.246 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:39.505 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T13:56:39.522 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-21T13:56:39.799 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-21T13:56:40.083 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-21T13:56:40.184 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-21T13:56:40.190 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T13:56:40.450 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T13:56:40.569 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:40.576 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T13:56:40.695 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-21T13:56:40.702 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T13:56:40.963 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-21T13:56:40.995 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T13:56:41.223 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-21T13:56:41.396 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T13:56:41.540 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-21T13:56:41.647 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T13:56:42.015 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T13:56:42.167 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-21T13:56:42.309 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T13:56:42.436 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-21T13:56:42.562 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-21T13:56:42.652 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T13:56:42.688 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-21T13:56:42.903 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T13:56:43.006 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-21T13:56:43.029 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:43.347 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T13:56:43.399 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-21T13:56:43.642 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-21T13:56:43.648 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T13:56:44.027 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-21T13:56:44.337 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-21T13:56:44.705 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-21T13:56:44.812 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:44.946 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T13:56:44.964 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-21T13:56:45.197 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T13:56:45.299 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T13:56:45.399 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:45.399 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T13:56:45.693 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T13:56:45.708 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-21T13:56:45.944 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T13:56:46.043 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-21T13:56:46.195 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:46.321 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-21T13:56:46.447 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T13:56:46.748 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T13:56:46.999 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T13:56:47.191 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:47.259 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T13:56:47.317 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-21T13:56:47.502 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T13:56:47.594 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-21T13:56:47.720 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-21T13:56:47.753 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T13:56:47.846 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-21T13:56:48.012 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T13:56:48.138 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T13:56:48.147 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-21T13:56:48.390 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-21T13:56:48.422 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T13:56:48.524 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T13:56:48.658 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:48.784 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-21T13:56:48.808 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T13:56:48.911 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-21T13:56:49.101 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T13:56:49.221 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-21T13:56:49.344 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:49.480 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-21T13:56:49.748 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-21T13:56:49.770 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T13:56:50.005 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T13:56:50.007 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-21T13:56:50.131 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T13:56:50.284 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-21T13:56:50.524 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T13:56:50.585 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-21T13:56:50.711 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-21T13:56:50.776 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T13:56:51.004 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-21T13:56:51.018 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:51.144 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T13:56:51.147 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-21T13:56:51.456 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-21T13:56:51.487 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T13:56:51.749 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-21T13:56:51.788 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T13:56:52.026 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-21T13:56:52.073 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T13:56:52.199 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T13:56:52.430 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-21T13:56:52.466 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T13:56:52.671 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-21T13:56:52.734 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T13:56:52.813 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-21T13:56:52.994 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T13:56:53.215 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-21T13:56:53.395 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T13:56:53.474 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-21T13:56:53.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T13:56:53.743 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-21T13:56:53.869 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-21T13:56:54.057 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T13:56:54.192 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:54.195 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-21T13:56:54.318 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:54.444 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:54.538 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-21T13:56:54.570 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:54.696 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:54.806 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-21T13:56:54.907 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-21T13:56:54.907 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T13:56:55.166 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-21T13:56:55.167 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:55.294 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:55.436 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:55.476 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-21T13:56:55.652 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T13:56:55.653 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T13:56:55.744 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-21T13:56:56.129 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-21T13:56:56.137 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:56.264 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:56.365 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T13:56:56.414 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-21T13:56:56.750 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-21T13:56:56.884 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.010 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.136 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.263 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.389 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.561 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.626 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-21T13:56:57.687 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.813 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.927 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:57.939 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:58.065 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:58.068 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:58.196 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:58.398 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T13:56:58.398 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-21T13:56:58.566 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-09-21T13:56:58.873 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:58.952 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-09-21T13:56:58.999 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:56:59.120 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-09-21T13:56:59.133 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T13:56:59.133 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-21T13:56:59.266 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T13:56:59.572 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T13:57:00.019 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.170 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.313 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.415 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.524 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.621 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:57:00.621 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:57:00.692 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:00.818 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:01.063 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:01.354 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-09-21T13:57:01.410 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T13:57:01.739 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-09-21T13:57:01.840 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:01.933 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-09-21T13:57:01.946 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-21T13:57:02.075 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T13:57:02.075 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T13:57:02.086 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-21T13:57:02.386 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-21T13:57:02.516 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:02.728 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T13:57:02.729 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T13:57:02.879 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:02.989 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:03.193 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:03.454 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:57:03.454 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-21T13:57:03.476 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T13:57:03.476 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T13:57:03.932 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:03.953 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:04.079 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:04.230 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:04.293 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-21T13:57:04.443 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T13:57:04.443 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T13:57:04.759 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:04.922 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:04.979 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T13:57:04.979 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-21T13:57:05.098 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:05.225 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:05.376 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:05.453 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:05.667 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T13:57:05.667 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-21T13:57:05.738 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T13:57:06.138 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T13:57:06.433 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-21T13:57:06.948 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:07.133 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:07.214 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T13:57:07.285 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:07.482 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T13:57:07.482 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-21T13:57:07.722 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T13:57:07.727 DEBUG:teuthology.parallel:result is None 2024-09-21T13:57:08.230 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:08.500 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:08.927 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:09.146 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (18.2.4-855-g19e2a2be-1jammy) ... 2024-09-21T13:57:09.608 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-21T13:57:10.482 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-21T13:57:10.966 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-21T13:57:10.971 DEBUG:teuthology.parallel:result is None 2024-09-21T13:57:10.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T13:57:11.121 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-09-21T13:57:11.139 INFO:teuthology.orchestra.run.smithi079.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:57:11.139 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:57:11.140 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-21T13:57:11.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-21T13:57:11.279 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-09-21T13:57:11.298 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:57:11.298 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-855-g19e2a2be-1jammy 2024-09-21T13:57:11.299 INFO:teuthology.task.install:The correct ceph version 18.2.4-855-g19e2a2be-1jammy is installed. 2024-09-21T13:57:11.300 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T13:57:11.301 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:11.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T13:57:11.314 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:11.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T13:57:11.355 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T13:57:11.356 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:11.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T13:57:11.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T13:57:11.422 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:11.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T13:57:11.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T13:57:11.490 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T13:57:11.490 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:11.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T13:57:11.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T13:57:11.559 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:11.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T13:57:11.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T13:57:11.626 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T13:57:11.626 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:11.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T13:57:11.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T13:57:11.695 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:11.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T13:57:11.708 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T13:57:11.761 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T13:57:11.841 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T13:57:11.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-09-21T13:57:11.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-09-21T13:57:11.857 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T13:57:11.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T13:57:11.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T13:57:11.909 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T13:57:11.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T13:57:11.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T13:57:11.975 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T13:57:11.975 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T13:57:11.976 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900', 'branch': 'reef', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909900', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4623, 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'sleep_before_teardown': 0, 'subset': '80/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_a477b1894d5c5a613f23260ca0e6b96d79652ba7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7', 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxbBaccP8SAp3u1od3vvTde16Yj7+02BEZHsxaJx8ACdojId8jz6RTAoLKEtT32SA+/WNajfU+97qG6fpZDppA=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFInB3dkq3zPXttRllPs7/8IsOSCoUk7YCQHKmFnhktt0v1JRNN0gpDU8OVTbVnfQp4OPlUFhMnr2AjygZRLBmE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_22:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T13:57:11.976 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T13:57:12.009 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T13:57:12.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T13:57:12.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T13:57:12.071 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:12.071 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T13:57:12.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T13:57:12.116 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 13:51:56.173910326 +0000 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 13:51:55.941912399 +0000 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 13:51:55.941912399 +0000 2024-09-21T13:57:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-21T13:57:12.165 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T13:57:12.218 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T13:57:12.218 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T13:57:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.00044765 s, 1.1 MB/s 2024-09-21T13:57:12.220 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T13:57:12.269 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-21T13:57:12.315 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 13:51:56.625906289 +0000 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 13:51:56.393908361 +0000 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 13:51:56.393908361 +0000 2024-09-21T13:57:12.316 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-21T13:57:12.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T13:57:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T13:57:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T13:57:12.370 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000420757 s, 1.2 MB/s 2024-09-21T13:57:12.371 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T13:57:12.421 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-21T13:57:12.467 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 13:51:57.101902037 +0000 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 13:51:56.861904181 +0000 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 13:51:56.861904181 +0000 2024-09-21T13:57:12.468 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-21T13:57:12.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T13:57:12.521 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T13:57:12.521 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T13:57:12.521 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000336947 s, 1.5 MB/s 2024-09-21T13:57:12.522 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T13:57:12.568 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-21T13:57:12.615 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 13:51:57.569897857 +0000 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 13:51:57.325900036 +0000 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 13:51:57.325900036 +0000 2024-09-21T13:57:12.616 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-21T13:57:12.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T13:57:12.670 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T13:57:12.670 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T13:57:12.670 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000402117 s, 1.3 MB/s 2024-09-21T13:57:12.671 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T13:57:12.721 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:12.721 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:12.721 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T13:57:12.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T13:57:12.727 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 13:51:51.339203513 +0000 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 13:51:51.335203549 +0000 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 13:51:51.335203549 +0000 2024-09-21T13:57:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-21T13:57:12.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T13:57:12.829 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T13:57:12.829 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T13:57:12.829 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000448843 s, 1.1 MB/s 2024-09-21T13:57:12.830 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T13:57:12.880 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-21T13:57:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T13:57:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:12.926 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-21T13:57:12.926 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:12.927 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 13:51:52.051197153 +0000 2024-09-21T13:57:12.927 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 13:51:51.811199296 +0000 2024-09-21T13:57:12.927 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 13:51:51.811199296 +0000 2024-09-21T13:57:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-21T13:57:12.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T13:57:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T13:57:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T13:57:12.981 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000334426 s, 1.5 MB/s 2024-09-21T13:57:12.982 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T13:57:13.031 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-21T13:57:13.078 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T13:57:13.078 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 13:51:52.547192723 +0000 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 13:51:52.279195116 +0000 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 13:51:52.279195116 +0000 2024-09-21T13:57:13.079 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-21T13:57:13.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T13:57:13.133 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T13:57:13.133 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T13:57:13.133 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000352173 s, 1.5 MB/s 2024-09-21T13:57:13.134 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T13:57:13.183 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-21T13:57:13.230 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T13:57:13.230 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T13:57:13.230 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-21T13:57:13.230 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T13:57:13.231 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-21 13:51:53.019188507 +0000 2024-09-21T13:57:13.231 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-21 13:51:52.787190579 +0000 2024-09-21T13:57:13.231 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-21 13:51:52.787190579 +0000 2024-09-21T13:57:13.231 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-09-21T13:57:13.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T13:57:13.285 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-21T13:57:13.285 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-21T13:57:13.285 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000330838 s, 1.5 MB/s 2024-09-21T13:57:13.286 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T13:57:13.336 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:13.336 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T13:57:13.336 INFO:tasks.ceph:Generating config... 2024-09-21T13:57:13.337 INFO:tasks.ceph:[client] rbd cache = True 2024-09-21T13:57:13.337 INFO:tasks.ceph:[client] rbd cache policy = writearound 2024-09-21T13:57:13.337 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-21T13:57:13.337 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-21T13:57:13.337 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-21T13:57:13.337 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T13:57:13.337 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T13:57:13.337 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T13:57:13.337 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T13:57:13.337 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T13:57:13.337 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T13:57:13.338 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T13:57:13.339 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-21T13:57:13.339 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T13:57:13.339 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-21T13:57:13.339 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T13:57:13.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T13:57:13.372 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T13:57:13.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T13:57:13.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T13:57:13.515 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]'), ('mon.b', '172.21.15.134')] 2024-09-21T13:57:13.516 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.134', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writearound'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-21T13:57:13.516 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:13.517 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T13:57:13.564 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --add b 172.21.15.134 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:13.649 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:13.649 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid af11199c-39d9-4003-9df0-1f9fd66ab792 2024-09-21T13:57:13.649 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = pacific 2024-09-21T13:57:13.649 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2024-09-21T13:57:13.649 INFO:teuthology.orchestra.run.smithi079.stdout:fsid af11199c-39d9-4003-9df0-1f9fd66ab792 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2024-09-21T13:57:13.650673+0000 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-21T13:57:13.650673+0000 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 16 (pacific) 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-21T13:57:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-21T13:57:13.651 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T13:57:13.700 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID af11199c-39d9-4003-9df0-1f9fd66ab792... 2024-09-21T13:57:13.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T13:57:13.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T13:57:13.773 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-21T13:57:13.773 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-09-21T13:57:13.773 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T13:57:13.773 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-09-21T13:57:13.773 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T13:57:13.774 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-09-21T13:57:13.775 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-09-21T13:57:13.776 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.134" 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: mon client directed command retry = 5 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on pool no app = False 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: ms inject socket failures = 5000 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = af11199c-39d9-4003-9df0-1f9fd66ab792 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.777 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-09-21T13:57:13.778 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-09-21T13:57:13.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bdev async discard = True 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bdev enable discard = True 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore allocator = bitmap 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T13:57:13.780 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: osd blocked scrub grace period = 3600 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: osd max markdown count = 1000 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: osd shutdown pgref assert = True 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-21T13:57:13.781 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.782 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-09-21T13:57:13.783 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-09-21T13:57:13.784 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-09-21T13:57:13.784 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-09-21T13:57:13.784 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T13:57:13.784 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T13:57:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: rbd cache = True 2024-09-21T13:57:13.785 INFO:teuthology.orchestra.run.smithi079.stdout: rbd cache policy = writearound 2024-09-21T13:57:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-09-21T13:57:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-09-21T13:57:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-09-21T13:57:13.786 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-09-21T13:57:13.786 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-09-21T13:57:13.786 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.787 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-09-21T13:57:13.788 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.134" 2024-09-21T13:57:13.789 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on pool no app = False 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 5000 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = af11199c-39d9-4003-9df0-1f9fd66ab792 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-09-21T13:57:13.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-09-21T13:57:13.791 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.792 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-09-21T13:57:13.793 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-09-21T13:57:13.794 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-09-21T13:57:13.795 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-09-21T13:57:13.796 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: rbd cache = True 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout: rbd cache policy = writearound 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-09-21T13:57:13.797 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-09-21T13:57:13.797 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T13:57:13.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T13:57:13.879 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T13:57:13.879 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:13.880 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T13:57:13.884 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:13.884 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T13:57:13.931 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:57:13.931 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:13.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T13:57:13.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T13:57:13.995 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:13.995 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:14.043 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:57:14.044 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:14.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T13:57:14.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T13:57:14.066 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:14.066 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:14.115 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T13:57:14.115 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T13:57:14.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T13:57:14.157 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-21T13:57:14.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T13:57:14.203 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T13:57:14.214 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T13:57:14.214 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T13:57:14.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T13:57:14.248 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T13:57:14.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T13:57:14.292 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T13:57:14.302 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T13:57:14.302 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-21T13:57:14.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T13:57:14.318 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:14.318 INFO:tasks.ceph:role: osd.0 2024-09-21T13:57:14.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:57:14.319 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:14.382 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:14.383 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:14.383 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:14.864 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-21T13:57:14.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-21T13:57:14.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T13:57:15.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T13:57:15.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:15.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T13:57:15.075 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:15.075 INFO:tasks.ceph:role: osd.1 2024-09-21T13:57:15.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:57:15.076 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T13:57:15.139 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:15.139 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:15.140 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:15.590 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-21T13:57:15.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-21T13:57:15.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T13:57:15.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T13:57:15.730 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:15.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:15.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T13:57:15.787 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:15.787 INFO:tasks.ceph:role: osd.2 2024-09-21T13:57:15.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:57:15.787 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T13:57:15.851 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:15.851 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:15.852 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:15.852 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:15.852 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:16.321 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-21T13:57:16.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-21T13:57:16.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-21T13:57:16.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T13:57:16.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:16.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T13:57:16.530 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:16.531 INFO:tasks.ceph:role: osd.3 2024-09-21T13:57:16.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T13:57:16.531 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T13:57:16.591 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:16.591 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:16.592 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:16.592 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:16.592 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:17.077 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-21T13:57:17.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-21T13:57:17.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-21T13:57:17.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T13:57:17.243 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:17.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:17.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:17.353 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.352+0000 7f4df4d147c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-21T13:57:17.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.356+0000 7f4df4d147c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-21T13:57:17.356 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.356+0000 7f4df4d147c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-21T13:57:17.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.356+0000 7f4df4d147c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-21T13:57:17.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.356+0000 7f4df4d147c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-21T13:57:17.357 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:17.356+0000 7f4df4d147c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-21T13:57:20.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T13:57:20.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:20.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-21T13:57:20.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-21T13:57:20.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-21T13:57:20.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-21T13:57:20.430 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-21T13:57:20.431 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:20.427+0000 7fb8c6bf27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-21T13:57:23.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T13:57:23.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.559+0000 7fd94dbf37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-21T13:57:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.559+0000 7fd94dbf37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-21T13:57:23.562 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.559+0000 7fd94dbf37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-21T13:57:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.559+0000 7fd94dbf37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-21T13:57:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.559+0000 7fd94dbf37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-21T13:57:23.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:23.563+0000 7fd94dbf37c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-21T13:57:26.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T13:57:26.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:26.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.679+0000 7f811df2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-21T13:57:26.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.679+0000 7f811df2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-21T13:57:26.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.679+0000 7f811df2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-21T13:57:26.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.679+0000 7f811df2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-21T13:57:26.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.679+0000 7f811df2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-21T13:57:26.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T13:57:26.683+0000 7f811df2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-21T13:57:29.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T13:57:29.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-21T13:57:29.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:29.735 INFO:tasks.ceph:role: osd.4 2024-09-21T13:57:29.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:57:29.736 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:29.799 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:29.799 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:29.799 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:30.289 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T13:57:30.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T13:57:30.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-21T13:57:30.449 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-21T13:57:30.460 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:30.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:30.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-21T13:57:30.513 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:30.513 INFO:tasks.ceph:role: osd.5 2024-09-21T13:57:30.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:57:30.514 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T13:57:30.573 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:30.573 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:30.573 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:30.573 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:30.574 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:31.015 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T13:57:31.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T13:57:31.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-21T13:57:31.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-21T13:57:31.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:31.152 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-21T13:57:31.206 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:31.206 INFO:tasks.ceph:role: osd.6 2024-09-21T13:57:31.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:57:31.206 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:31.270 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:31.724 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T13:57:31.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T13:57:31.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-21T13:57:31.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-21T13:57:31.874 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:31.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:31.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-21T13:57:31.930 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-21T13:57:31.930 INFO:tasks.ceph:role: osd.7 2024-09-21T13:57:31.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:57:31.931 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T13:57:31.999 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T13:57:32.493 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2024-09-21T13:57:32.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-09-21T13:57:32.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-21T13:57:32.658 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-21T13:57:32.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:57:32.670 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-09-21T13:57:32.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:32.783 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-21T13:57:32.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-21T13:57:32.784 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-21T13:57:32.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-21T13:57:32.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-21T13:57:32.785 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:32.780+0000 7f8c2bd437c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-21T13:57:35.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T13:57:35.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:35.860 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.856+0000 7f25b58557c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-21T13:57:35.861 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.856+0000 7f25b58557c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-21T13:57:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.856+0000 7f25b58557c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-21T13:57:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.856+0000 7f25b58557c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-21T13:57:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.856+0000 7f25b58557c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-21T13:57:35.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:35.860+0000 7f25b58557c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-21T13:57:38.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T13:57:38.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:38.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-21T13:57:38.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-21T13:57:38.975 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-21T13:57:38.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-21T13:57:38.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-21T13:57:38.976 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:38.972+0000 7fbe12cae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-21T13:57:41.950 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-21T13:57:42.006 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:42.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-21T13:57:42.087 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-21T13:57:42.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-21T13:57:42.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-21T13:57:42.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-21T13:57:42.088 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-21T13:57:42.084+0000 7f1efc5767c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-21T13:57:45.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-21T13:57:45.106 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T13:57:45.106 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-21T13:57:45.120 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T13:57:45.174 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T13:57:45.228 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T13:57:45.283 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T13:57:45.339 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T13:57:45.353 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-21T13:57:45.411 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.411 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-21T13:57:45.465 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-21T13:57:45.521 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-21T13:57:45.573 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:45.573 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T13:57:45.579 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:45.579 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T13:57:45.618 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T13:57:45.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T13:57:45.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC60O5m0nN2CRAAQDB75BKWTOVDWH7mnlYlng== 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC90O5muHUiFRAAePFgynUyQg09cGdXdu0aPw== 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDA0O5m1SGxGRAAoaXqYd6zyk7stkxdhJOB6A== 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-09-21T13:57:45.664 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDD0O5m5yGZIRAAEZmpalfk1C/38P/omno0Sw== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDG0O5mL7q8KBAAraFGGoRf4quxHIIVPWpyZg== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC60O5mmIw0DBAABsB9dTK2CrlywMyQFk3Bmg== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDM0O5mzO7MLhAAXwm/hrpC4WuqRP11VgrPyA== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDP0O5mthNnMxAAajqUi1Tj0pHZwh9r68GM+g== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDS0O5mn+w6OhAA77GHPgzZfUzMO7PkNTDvVA== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDW0O5m0npNBRAAr0cZnOq03EXtWdA2w6rHKQ== 2024-09-21T13:57:45.665 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-09-21T13:57:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC60O5maf7hDhAA5nYVQ5ueGwG66VBbl1zt7Q== 2024-09-21T13:57:45.666 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-09-21T13:57:45.666 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC60O5mjcKDERAAQ+Vll9VFv+fmi/fJvfA6mQ== 2024-09-21T13:57:45.672 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2024-09-21T13:57:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC60O5m0nN2CRAAQDB75BKWTOVDWH7mnlYlng== 2024-09-21T13:57:45.672 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2024-09-21T13:57:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC90O5muHUiFRAAePFgynUyQg09cGdXdu0aPw== 2024-09-21T13:57:45.672 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDA0O5m1SGxGRAAoaXqYd6zyk7stkxdhJOB6A== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDD0O5m5yGZIRAAEZmpalfk1C/38P/omno0Sw== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDG0O5mL7q8KBAAraFGGoRf4quxHIIVPWpyZg== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC60O5mmIw0DBAABsB9dTK2CrlywMyQFk3Bmg== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDM0O5mzO7MLhAAXwm/hrpC4WuqRP11VgrPyA== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDP0O5mthNnMxAAajqUi1Tj0pHZwh9r68GM+g== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDS0O5mn+w6OhAA77GHPgzZfUzMO7PkNTDvVA== 2024-09-21T13:57:45.673 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2024-09-21T13:57:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDW0O5m0npNBRAAr0cZnOq03EXtWdA2w6rHKQ== 2024-09-21T13:57:45.674 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-09-21T13:57:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC60O5maf7hDhAA5nYVQ5ueGwG66VBbl1zt7Q== 2024-09-21T13:57:45.674 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-09-21T13:57:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQC60O5mjcKDERAAQ+Vll9VFv+fmi/fJvfA6mQ== 2024-09-21T13:57:45.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T13:57:45.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T13:57:45.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:45.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T13:57:46.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T13:57:46.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T13:57:46.471 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T13:57:46.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T13:57:46.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T13:57:46.572 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T13:57:46.624 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T13:57:46.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T13:57:46.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T13:57:46.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T13:57:46.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-21T13:57:46.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T13:57:46.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-21T13:57:46.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-21T13:57:46.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T13:57:46.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-21T13:57:47.006 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:47.008 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T13:57:47.053 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T13:57:47.053 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T13:57:47.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T13:57:47.056 INFO:tasks.ceph.mon.a:Started 2024-09-21T13:57:47.056 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-21T13:57:47.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-21T13:57:47.059 INFO:tasks.ceph.mon.c:Started 2024-09-21T13:57:47.059 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-21T13:57:47.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-21T13:57:47.099 INFO:tasks.ceph.mon.b:Started 2024-09-21T13:57:47.099 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T13:57:47.099 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-21T13:57:47.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-21T13:57:47.101 INFO:tasks.ceph.mgr.y:Started 2024-09-21T13:57:47.101 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T13:57:47.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T13:57:47.103 INFO:tasks.ceph.mgr.x:Started 2024-09-21T13:57:47.103 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T13:57:47.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T13:57:52.584 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-21T13:57:52.603 INFO:tasks.ceph:check_enable_crimson: False 2024-09-21T13:57:52.603 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T13:57:52.604 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:52.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T13:57:52.618 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:52.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T13:57:52.669 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:52.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T13:57:52.721 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T13:57:52.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T13:57:52.743 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:52.740+0000 7fe9a3bfa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T13:57:52.773 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:52.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-21T13:57:52.786 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:52.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-21T13:57:52.840 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:52.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-21T13:57:52.894 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-21T13:57:52.894 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-21T13:57:52.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 4f3cec52-e90a-4dc6-8a9d-879659a7f8b3 0 2024-09-21T13:57:53.201 INFO:teuthology.orchestra.run.smithi134.stdout:0 2024-09-21T13:57:53.210 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:53.208+0000 7fe9a3bfa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T13:57:53.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new f30fdaae-2baf-49e5-b8c2-24477eabf5c6 1 2024-09-21T13:57:53.395 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:53.395+0000 7ff599255180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-21T13:57:53.428 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:53.424+0000 7fe9a3bfa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T13:57:53.438 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-09-21T13:57:53.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 54acbaba-89a5-4b6c-bd93-89e0683f2125 2 2024-09-21T13:57:53.651 INFO:teuthology.orchestra.run.smithi134.stdout:2 2024-09-21T13:57:53.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 76fc66bf-6186-4666-b92f-c8093d20d625 3 2024-09-21T13:57:53.871 INFO:teuthology.orchestra.run.smithi134.stdout:3 2024-09-21T13:57:53.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c90b7f74-168e-4c89-b1cf-c9ce463afa6e 4 2024-09-21T13:57:53.894 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:53.891+0000 7ff599255180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-21T13:57:54.039 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.036+0000 7fe9a3bfa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T13:57:54.090 INFO:teuthology.orchestra.run.smithi134.stdout:4 2024-09-21T13:57:54.095 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.092+0000 7fe9a3bfa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T13:57:54.107 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new b837d993-44f1-4dd3-99f7-675e6abcd9c7 5 2024-09-21T13:57:54.114 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.111+0000 7ff599255180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-21T13:57:54.151 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.148+0000 7fe9a3bfa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T13:57:54.233 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.228+0000 7fe9a3bfa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T13:57:54.285 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.284+0000 7fe9a3bfa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T13:57:54.303 INFO:teuthology.orchestra.run.smithi134.stdout:5 2024-09-21T13:57:54.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c68ceefc-f355-4f66-870e-95ce4a9bc37e 6 2024-09-21T13:57:54.366 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.364+0000 7fe9a3bfa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T13:57:54.420 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.416+0000 7fe9a3bfa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T13:57:54.566 INFO:teuthology.orchestra.run.smithi134.stdout:6 2024-09-21T13:57:54.579 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.576+0000 7fe9a3bfa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T13:57:54.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new e1909a46-859c-45e8-b84b-0e11db556c48 7 2024-09-21T13:57:54.640 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:54.636+0000 7fe9a3bfa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T13:57:54.664 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.663+0000 7ff599255180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-21T13:57:54.717 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.715+0000 7ff599255180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-21T13:57:54.770 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.767+0000 7ff599255180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-21T13:57:54.823 INFO:teuthology.orchestra.run.smithi134.stdout:7 2024-09-21T13:57:54.839 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T13:57:54.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-21T13:57:54.842 INFO:tasks.ceph.osd.0:Started 2024-09-21T13:57:54.842 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T13:57:54.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-21T13:57:54.844 INFO:tasks.ceph.osd.1:Started 2024-09-21T13:57:54.844 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T13:57:54.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-21T13:57:54.846 INFO:tasks.ceph.osd.2:Started 2024-09-21T13:57:54.847 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T13:57:54.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-21T13:57:54.849 INFO:tasks.ceph.osd.3:Started 2024-09-21T13:57:54.849 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-21T13:57:54.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-21T13:57:54.849 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.847+0000 7ff599255180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-21T13:57:54.882 INFO:tasks.ceph.osd.4:Started 2024-09-21T13:57:54.882 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-21T13:57:54.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-21T13:57:54.884 INFO:tasks.ceph.osd.5:Started 2024-09-21T13:57:54.884 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-21T13:57:54.884 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-21T13:57:54.886 INFO:tasks.ceph.osd.6:Started 2024-09-21T13:57:54.886 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T13:57:54.886 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T13:57:54.888 INFO:tasks.ceph.osd.7:Started 2024-09-21T13:57:54.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T13:57:54.921 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:54.919+0000 7ff599255180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-21T13:57:55.018 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:55.015+0000 7ff599255180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-21T13:57:55.071 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:55.071+0000 7ff599255180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-21T13:57:55.094 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:57:55.094 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:57:54.820932+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:57:55.110 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T13:57:55.110 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T13:57:55.225 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:55.223+0000 7ff599255180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-21T13:57:55.243 INFO:tasks.ceph.mgr.x.smithi134.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T13:57:55.243 INFO:tasks.ceph.mgr.x.smithi134.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T13:57:55.243 INFO:tasks.ceph.mgr.x.smithi134.stderr: from numpy import show_config as show_numpy_config 2024-09-21T13:57:55.284 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:55.283+0000 7ff599255180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-21T13:57:55.290 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:57:55.288+0000 7f30def187c0 -1 Falling back to public interface 2024-09-21T13:57:55.291 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:57:55.288+0000 7f53f25ed7c0 -1 Falling back to public interface 2024-09-21T13:57:55.297 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:55.292+0000 7fe9a3bfa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T13:57:55.306 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:57:55.304+0000 7f42c3d267c0 -1 Falling back to public interface 2024-09-21T13:57:55.430 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:55.428+0000 7fe9a3bfa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T13:57:55.475 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:57:55.475+0000 7f85cd2077c0 -1 Falling back to public interface 2024-09-21T13:57:55.483 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:57:55.483+0000 7f950fa9f7c0 -1 Falling back to public interface 2024-09-21T13:57:55.499 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:57:55.499+0000 7f1e28c107c0 -1 Falling back to public interface 2024-09-21T13:57:55.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:57:55.499+0000 7fd6b8f147c0 -1 Falling back to public interface 2024-09-21T13:57:55.554 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:57:55.552+0000 7f9c9c3a97c0 -1 Falling back to public interface 2024-09-21T13:57:55.595 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:55.592+0000 7fe9a3bfa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T13:57:55.659 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:55.656+0000 7fe9a3bfa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T13:57:55.791 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:55.788+0000 7fe9a3bfa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T13:57:55.917 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T13:57:55.939 INFO:tasks.ceph.mgr.y.smithi079.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-21T13:57:55.940 INFO:tasks.ceph.mgr.y.smithi079.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-21T13:57:55.940 INFO:tasks.ceph.mgr.y.smithi079.stderr: from numpy import show_config as show_numpy_config 2024-09-21T13:57:55.975 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:55.975+0000 7ff599255180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-21T13:57:56.101 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-21T13:57:56.101 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:57:54.820932+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:57:56.116 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T13:57:56.125 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:56.123+0000 7ff599255180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-21T13:57:56.300 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:56.299+0000 7ff599255180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-21T13:57:56.370 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:56.367+0000 7ff599255180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-21T13:57:56.404 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:56.400+0000 7fe9a3bfa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T13:57:56.480 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:56.476+0000 7fe9a3bfa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T13:57:56.513 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:56.511+0000 7ff599255180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-21T13:57:56.660 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:56.656+0000 7fe9a3bfa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T13:57:56.733 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:56.732+0000 7fe9a3bfa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T13:57:57.022 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:57.020+0000 7fe9a3bfa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T13:57:57.083 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:57.080+0000 7fe9a3bfa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T13:57:57.108 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.107+0000 7ff599255180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-21T13:57:57.192 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.191+0000 7ff599255180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-21T13:57:57.371 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.371+0000 7ff599255180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-21T13:57:57.444 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.443+0000 7ff599255180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-21T13:57:57.733 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.731+0000 7ff599255180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-21T13:57:57.794 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-21T13:57:57.791+0000 7ff599255180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-21T13:57:58.123 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:58.120+0000 7fe94b1aa640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-21T13:57:58.130 INFO:tasks.ceph.mgr.x.smithi134.stderr:2024-09-21T13:57:58.128+0000 7fe94b1aa640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T13:57:59.146 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:57:59.144+0000 7f42c3d267c0 -1 osd.5 0 log_to_monitors true 2024-09-21T13:57:59.196 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:57:59.192+0000 7f30def187c0 -1 osd.7 0 log_to_monitors true 2024-09-21T13:57:59.209 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:57:59.208+0000 7f53f25ed7c0 -1 osd.6 0 log_to_monitors true 2024-09-21T13:57:59.313 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:57:59.308+0000 7f9c9c3a97c0 -1 osd.4 0 log_to_monitors true 2024-09-21T13:57:59.324 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:57:59.323+0000 7f950fa9f7c0 -1 osd.3 0 log_to_monitors true 2024-09-21T13:57:59.360 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:57:59.359+0000 7fd6b8f147c0 -1 osd.1 0 log_to_monitors true 2024-09-21T13:57:59.362 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:57:59.359+0000 7f85cd2077c0 -1 osd.2 0 log_to_monitors true 2024-09-21T13:57:59.365 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:57:59.363+0000 7f1e28c107c0 -1 osd.0 0 log_to_monitors true 2024-09-21T13:58:02.606 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:02.603+0000 7f1e24392640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T13:58:02.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:02.611+0000 7fd6b4696640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T13:58:02.629 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:02.627+0000 7f950b221640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T13:58:02.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:02.643+0000 7f1e1c9d7640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.646 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:02.647+0000 7f85c8989640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T13:58:02.647 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:02.647+0000 7fd6accdb640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.653 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:02.648+0000 7f30da69a640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T13:58:02.659 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:02.659+0000 7f9503866640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.665 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:02.660+0000 7f53edd6f640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T13:58:02.671 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:02.671+0000 7f85c0fce640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.677 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:02.676+0000 7f42bf4a8640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T13:58:02.686 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:02.684+0000 7f30d2cdf640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.695 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:02.688+0000 7f9c97b2b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T13:58:02.695 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:02.692+0000 7f53e63b4640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.706 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:02.704+0000 7f42b7aed640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.718 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:02.716+0000 7f9c90170640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:58:02.923 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T13:58:03.216 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-21T13:58:03.216 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":12,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:58:00.489735+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:58:03.234 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-21T13:58:10.041 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T13:58:10.340 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-21T13:58:10.340 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":17,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:58:07.891958+0000","last_up_change":"2024-09-21T13:58:03.658559+0000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6801","nonce":2163234632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6803","nonce":2163234632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6807","nonce":2163234632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6805","nonce":2163234632}]},"public_addr":"172.21.15.134:6801/2163234632","cluster_addr":"172.21.15.134:6803/2163234632","heartbeat_back_addr":"172.21.15.134:6807/2163234632","heartbeat_front_addr":"172.21.15.134:6805/2163234632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:58:10.357 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-21T13:58:10.357 INFO:tasks.ceph:Creating RBD pool 2024-09-21T13:58:10.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T13:58:10.939 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2024-09-21T13:58:10.963 DEBUG:teuthology.orchestra.run.smithi079:> rbd --cluster ceph pool init rbd 2024-09-21T13:58:13.996 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T13:58:13.996 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T13:58:13.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T13:58:13.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T13:58:13.997 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T13:58:14.347 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:14.364 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2862790701},{"type":"v1","addr":"172.21.15.134:6833","nonce":2862790701}]},"active_addr":"172.21.15.134:6833/2862790701","active_change":"2024-09-21T13:57:57.105624+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2859222480}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":2855921116}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":993891115}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":585469290}]}]} 2024-09-21T13:58:14.367 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T13:58:14.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T13:58:14.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T13:58:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:14.659 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:58:13.954253+0000","last_up_change":"2024-09-21T13:58:03.658559+0000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T13:58:10.681325+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6801","nonce":2163234632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6803","nonce":2163234632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6807","nonce":2163234632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6805","nonce":2163234632}]},"public_addr":"172.21.15.134:6801/2163234632","cluster_addr":"172.21.15.134:6803/2163234632","heartbeat_back_addr":"172.21.15.134:6807/2163234632","heartbeat_front_addr":"172.21.15.134:6805/2163234632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:58:14.676 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T13:58:14.676 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T13:58:14.973 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:14.973 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":21,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T13:58:13.954253+0000","last_up_change":"2024-09-21T13:58:03.658559+0000","last_in_change":"2024-09-21T13:57:54.820932+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T13:58:10.681325+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6801","nonce":2163234632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6803","nonce":2163234632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6807","nonce":2163234632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2163234632},{"type":"v1","addr":"172.21.15.134:6805","nonce":2163234632}]},"public_addr":"172.21.15.134:6801/2163234632","cluster_addr":"172.21.15.134:6803/2163234632","heartbeat_back_addr":"172.21.15.134:6807/2163234632","heartbeat_front_addr":"172.21.15.134:6805/2163234632","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T13:58:14.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T13:58:14.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T13:58:14.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T13:58:14.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T13:58:14.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T13:58:14.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T13:58:14.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T13:58:14.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T13:58:15.237 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-21T13:58:15.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T13:58:15.243 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:15.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T13:58:15.244 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:15.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T13:58:15.258 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-21T13:58:15.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T13:58:15.264 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-21T13:58:15.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T13:58:15.267 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-09-21T13:58:15.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T13:58:15.269 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:15.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T13:58:15.276 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-09-21T13:58:15.276 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T13:58:15.734 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-21T13:58:15.745 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-21T13:58:15.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2024-09-21T13:58:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-21T13:58:15.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2024-09-21T13:58:15.785 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-21T13:58:15.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-09-21T13:58:15.789 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:15.796 INFO:teuthology.orchestra.run.smithi079.stdout:55834574850 2024-09-21T13:58:15.808 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:15.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2024-09-21T13:58:15.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2024-09-21T13:58:15.824 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-21T13:58:15.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.3 2024-09-21T13:58:15.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-09-21T13:58:15.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2024-09-21T13:58:16.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T13:58:16.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T13:58:16.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T13:58:16.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T13:58:16.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T13:58:16.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T13:58:16.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T13:58:16.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T13:58:17.272 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-21T13:58:17.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-21T13:58:17.298 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.308 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:17.312 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:17.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-09-21T13:58:17.339 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-09-21T13:58:17.343 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.346 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-09-21T13:58:17.354 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-21T13:58:17.355 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-21T13:58:17.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-09-21T13:58:17.370 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-09-21T13:58:17.375 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-09-21T13:58:17.379 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.379 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2024-09-21T13:58:17.391 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-21T13:58:17.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-21T13:58:17.396 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-21T13:58:17.408 DEBUG:teuthology.parallel:result is None 2024-09-21T13:58:17.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T13:58:17.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:58:17.720 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:17.721 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:58:17.736 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T13:58:17.143014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219032,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2932736,"data_stored":1769022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.119109+0000","last_change":"2024-09-21T13:58:14.119109+0000","last_active":"2024-09-21T13:58:14.119109+0000","last_peered":"2024-09-21T13:58:14.119109+0000","last_clean":"2024-09-21T13:58:14.119109+0000","last_became_active":"2024-09-21T13:58:11.960695+0000","last_became_peered":"2024-09-21T13:58:11.960695+0000","last_unstale":"2024-09-21T13:58:14.119109+0000","last_undegraded":"2024-09-21T13:58:14.119109+0000","last_fullsized":"2024-09-21T13:58:14.119109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:37.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965360+0000","last_change":"2024-09-21T13:58:13.965360+0000","last_active":"2024-09-21T13:58:13.965360+0000","last_peered":"2024-09-21T13:58:13.965360+0000","last_clean":"2024-09-21T13:58:13.965360+0000","last_became_active":"2024-09-21T13:58:11.955322+0000","last_became_peered":"2024-09-21T13:58:11.955322+0000","last_unstale":"2024-09-21T13:58:13.965360+0000","last_undegraded":"2024-09-21T13:58:13.965360+0000","last_fullsized":"2024-09-21T13:58:13.965360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:38:29.040695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071457400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261122+0000","last_change":"2024-09-21T13:58:14.261122+0000","last_active":"2024-09-21T13:58:14.261122+0000","last_peered":"2024-09-21T13:58:14.261122+0000","last_clean":"2024-09-21T13:58:14.261122+0000","last_became_active":"2024-09-21T13:58:12.178049+0000","last_became_peered":"2024-09-21T13:58:12.178049+0000","last_unstale":"2024-09-21T13:58:14.261122+0000","last_undegraded":"2024-09-21T13:58:14.261122+0000","last_fullsized":"2024-09-21T13:58:14.261122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:56.580072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965696+0000","last_change":"2024-09-21T13:58:13.965696+0000","last_active":"2024-09-21T13:58:13.965696+0000","last_peered":"2024-09-21T13:58:13.965696+0000","last_clean":"2024-09-21T13:58:13.965696+0000","last_became_active":"2024-09-21T13:58:12.177138+0000","last_became_peered":"2024-09-21T13:58:12.177138+0000","last_unstale":"2024-09-21T13:58:13.965696+0000","last_undegraded":"2024-09-21T13:58:13.965696+0000","last_fullsized":"2024-09-21T13:58:13.965696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.103500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075207099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.975129+0000","last_change":"2024-09-21T13:58:13.973999+0000","last_active":"2024-09-21T13:58:13.975129+0000","last_peered":"2024-09-21T13:58:13.975129+0000","last_clean":"2024-09-21T13:58:13.975129+0000","last_became_active":"2024-09-21T13:58:11.956462+0000","last_became_peered":"2024-09-21T13:58:11.956462+0000","last_unstale":"2024-09-21T13:58:13.975129+0000","last_undegraded":"2024-09-21T13:58:13.975129+0000","last_fullsized":"2024-09-21T13:58:13.975129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:20:15.859666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972457+0000","last_change":"2024-09-21T13:58:13.972457+0000","last_active":"2024-09-21T13:58:13.972457+0000","last_peered":"2024-09-21T13:58:13.972457+0000","last_clean":"2024-09-21T13:58:13.972457+0000","last_became_active":"2024-09-21T13:58:11.950788+0000","last_became_peered":"2024-09-21T13:58:11.950788+0000","last_unstale":"2024-09-21T13:58:13.972457+0000","last_undegraded":"2024-09-21T13:58:13.972457+0000","last_fullsized":"2024-09-21T13:58:13.972457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.420761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054402300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261067+0000","last_change":"2024-09-21T13:58:14.261067+0000","last_active":"2024-09-21T13:58:14.261067+0000","last_peered":"2024-09-21T13:58:14.261067+0000","last_clean":"2024-09-21T13:58:14.261067+0000","last_became_active":"2024-09-21T13:58:11.955637+0000","last_became_peered":"2024-09-21T13:58:11.955637+0000","last_unstale":"2024-09-21T13:58:14.261067+0000","last_undegraded":"2024-09-21T13:58:14.261067+0000","last_fullsized":"2024-09-21T13:58:14.261067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:37.122435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972806+0000","last_change":"2024-09-21T13:58:13.972806+0000","last_active":"2024-09-21T13:58:13.972806+0000","last_peered":"2024-09-21T13:58:13.972806+0000","last_clean":"2024-09-21T13:58:13.972806+0000","last_became_active":"2024-09-21T13:58:11.955126+0000","last_became_peered":"2024-09-21T13:58:11.955126+0000","last_unstale":"2024-09-21T13:58:13.972806+0000","last_undegraded":"2024-09-21T13:58:13.972806+0000","last_fullsized":"2024-09-21T13:58:13.972806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:29.039520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T13:58:12.958106+0000","last_change":"2024-09-21T13:58:06.893092+0000","last_active":"2024-09-21T13:58:12.958106+0000","last_peered":"2024-09-21T13:58:12.958106+0000","last_clean":"2024-09-21T13:58:12.958106+0000","last_became_active":"2024-09-21T13:58:06.892337+0000","last_became_peered":"2024-09-21T13:58:06.892337+0000","last_unstale":"2024-09-21T13:58:12.958106+0000","last_undegraded":"2024-09-21T13:58:12.958106+0000","last_fullsized":"2024-09-21T13:58:12.958106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:24.144363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:58:17.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:58:18.009 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:18.010 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:58:18.026 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T13:58:17.143014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219032,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2932736,"data_stored":1769022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.119109+0000","last_change":"2024-09-21T13:58:14.119109+0000","last_active":"2024-09-21T13:58:14.119109+0000","last_peered":"2024-09-21T13:58:14.119109+0000","last_clean":"2024-09-21T13:58:14.119109+0000","last_became_active":"2024-09-21T13:58:11.960695+0000","last_became_peered":"2024-09-21T13:58:11.960695+0000","last_unstale":"2024-09-21T13:58:14.119109+0000","last_undegraded":"2024-09-21T13:58:14.119109+0000","last_fullsized":"2024-09-21T13:58:14.119109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:37.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965360+0000","last_change":"2024-09-21T13:58:13.965360+0000","last_active":"2024-09-21T13:58:13.965360+0000","last_peered":"2024-09-21T13:58:13.965360+0000","last_clean":"2024-09-21T13:58:13.965360+0000","last_became_active":"2024-09-21T13:58:11.955322+0000","last_became_peered":"2024-09-21T13:58:11.955322+0000","last_unstale":"2024-09-21T13:58:13.965360+0000","last_undegraded":"2024-09-21T13:58:13.965360+0000","last_fullsized":"2024-09-21T13:58:13.965360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:38:29.040695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071457400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261122+0000","last_change":"2024-09-21T13:58:14.261122+0000","last_active":"2024-09-21T13:58:14.261122+0000","last_peered":"2024-09-21T13:58:14.261122+0000","last_clean":"2024-09-21T13:58:14.261122+0000","last_became_active":"2024-09-21T13:58:12.178049+0000","last_became_peered":"2024-09-21T13:58:12.178049+0000","last_unstale":"2024-09-21T13:58:14.261122+0000","last_undegraded":"2024-09-21T13:58:14.261122+0000","last_fullsized":"2024-09-21T13:58:14.261122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:56.580072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965696+0000","last_change":"2024-09-21T13:58:13.965696+0000","last_active":"2024-09-21T13:58:13.965696+0000","last_peered":"2024-09-21T13:58:13.965696+0000","last_clean":"2024-09-21T13:58:13.965696+0000","last_became_active":"2024-09-21T13:58:12.177138+0000","last_became_peered":"2024-09-21T13:58:12.177138+0000","last_unstale":"2024-09-21T13:58:13.965696+0000","last_undegraded":"2024-09-21T13:58:13.965696+0000","last_fullsized":"2024-09-21T13:58:13.965696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.103500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075207099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.975129+0000","last_change":"2024-09-21T13:58:13.973999+0000","last_active":"2024-09-21T13:58:13.975129+0000","last_peered":"2024-09-21T13:58:13.975129+0000","last_clean":"2024-09-21T13:58:13.975129+0000","last_became_active":"2024-09-21T13:58:11.956462+0000","last_became_peered":"2024-09-21T13:58:11.956462+0000","last_unstale":"2024-09-21T13:58:13.975129+0000","last_undegraded":"2024-09-21T13:58:13.975129+0000","last_fullsized":"2024-09-21T13:58:13.975129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:20:15.859666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972457+0000","last_change":"2024-09-21T13:58:13.972457+0000","last_active":"2024-09-21T13:58:13.972457+0000","last_peered":"2024-09-21T13:58:13.972457+0000","last_clean":"2024-09-21T13:58:13.972457+0000","last_became_active":"2024-09-21T13:58:11.950788+0000","last_became_peered":"2024-09-21T13:58:11.950788+0000","last_unstale":"2024-09-21T13:58:13.972457+0000","last_undegraded":"2024-09-21T13:58:13.972457+0000","last_fullsized":"2024-09-21T13:58:13.972457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.420761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054402300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261067+0000","last_change":"2024-09-21T13:58:14.261067+0000","last_active":"2024-09-21T13:58:14.261067+0000","last_peered":"2024-09-21T13:58:14.261067+0000","last_clean":"2024-09-21T13:58:14.261067+0000","last_became_active":"2024-09-21T13:58:11.955637+0000","last_became_peered":"2024-09-21T13:58:11.955637+0000","last_unstale":"2024-09-21T13:58:14.261067+0000","last_undegraded":"2024-09-21T13:58:14.261067+0000","last_fullsized":"2024-09-21T13:58:14.261067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:37.122435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972806+0000","last_change":"2024-09-21T13:58:13.972806+0000","last_active":"2024-09-21T13:58:13.972806+0000","last_peered":"2024-09-21T13:58:13.972806+0000","last_clean":"2024-09-21T13:58:13.972806+0000","last_became_active":"2024-09-21T13:58:11.955126+0000","last_became_peered":"2024-09-21T13:58:11.955126+0000","last_unstale":"2024-09-21T13:58:13.972806+0000","last_undegraded":"2024-09-21T13:58:13.972806+0000","last_fullsized":"2024-09-21T13:58:13.972806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:29.039520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T13:58:12.958106+0000","last_change":"2024-09-21T13:58:06.893092+0000","last_active":"2024-09-21T13:58:12.958106+0000","last_peered":"2024-09-21T13:58:12.958106+0000","last_clean":"2024-09-21T13:58:12.958106+0000","last_became_active":"2024-09-21T13:58:06.892337+0000","last_became_peered":"2024-09-21T13:58:06.892337+0000","last_unstale":"2024-09-21T13:58:12.958106+0000","last_undegraded":"2024-09-21T13:58:12.958106+0000","last_fullsized":"2024-09-21T13:58:12.958106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:24.144363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:58:18.027 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T13:58:18.027 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T13:58:18.027 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T13:58:18.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T13:58:18.329 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:18.329 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T13:58:18.346 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T13:58:18.347 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-21T13:58:18.359 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-21T13:58:18.359 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': 'a477b1894d5c5a613f23260ca0e6b96d79652ba7'}} 2024-09-21T13:58:18.359 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-21T13:58:18.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-21T13:58:18.648 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-21T13:58:18.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T13:58:18.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:58:18.922 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:18.923 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:58:18.939 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-21T13:58:17.143014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219032,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2932736,"data_stored":1769022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.198685"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.119109+0000","last_change":"2024-09-21T13:58:14.119109+0000","last_active":"2024-09-21T13:58:14.119109+0000","last_peered":"2024-09-21T13:58:14.119109+0000","last_clean":"2024-09-21T13:58:14.119109+0000","last_became_active":"2024-09-21T13:58:11.960695+0000","last_became_peered":"2024-09-21T13:58:11.960695+0000","last_unstale":"2024-09-21T13:58:14.119109+0000","last_undegraded":"2024-09-21T13:58:14.119109+0000","last_fullsized":"2024-09-21T13:58:14.119109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:37.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965360+0000","last_change":"2024-09-21T13:58:13.965360+0000","last_active":"2024-09-21T13:58:13.965360+0000","last_peered":"2024-09-21T13:58:13.965360+0000","last_clean":"2024-09-21T13:58:13.965360+0000","last_became_active":"2024-09-21T13:58:11.955322+0000","last_became_peered":"2024-09-21T13:58:11.955322+0000","last_unstale":"2024-09-21T13:58:13.965360+0000","last_undegraded":"2024-09-21T13:58:13.965360+0000","last_fullsized":"2024-09-21T13:58:13.965360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:38:29.040695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071457400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261122+0000","last_change":"2024-09-21T13:58:14.261122+0000","last_active":"2024-09-21T13:58:14.261122+0000","last_peered":"2024-09-21T13:58:14.261122+0000","last_clean":"2024-09-21T13:58:14.261122+0000","last_became_active":"2024-09-21T13:58:12.178049+0000","last_became_peered":"2024-09-21T13:58:12.178049+0000","last_unstale":"2024-09-21T13:58:14.261122+0000","last_undegraded":"2024-09-21T13:58:14.261122+0000","last_fullsized":"2024-09-21T13:58:14.261122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:56.580072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965696+0000","last_change":"2024-09-21T13:58:13.965696+0000","last_active":"2024-09-21T13:58:13.965696+0000","last_peered":"2024-09-21T13:58:13.965696+0000","last_clean":"2024-09-21T13:58:13.965696+0000","last_became_active":"2024-09-21T13:58:12.177138+0000","last_became_peered":"2024-09-21T13:58:12.177138+0000","last_unstale":"2024-09-21T13:58:13.965696+0000","last_undegraded":"2024-09-21T13:58:13.965696+0000","last_fullsized":"2024-09-21T13:58:13.965696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.103500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075207099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.975129+0000","last_change":"2024-09-21T13:58:13.973999+0000","last_active":"2024-09-21T13:58:13.975129+0000","last_peered":"2024-09-21T13:58:13.975129+0000","last_clean":"2024-09-21T13:58:13.975129+0000","last_became_active":"2024-09-21T13:58:11.956462+0000","last_became_peered":"2024-09-21T13:58:11.956462+0000","last_unstale":"2024-09-21T13:58:13.975129+0000","last_undegraded":"2024-09-21T13:58:13.975129+0000","last_fullsized":"2024-09-21T13:58:13.975129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:20:15.859666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972457+0000","last_change":"2024-09-21T13:58:13.972457+0000","last_active":"2024-09-21T13:58:13.972457+0000","last_peered":"2024-09-21T13:58:13.972457+0000","last_clean":"2024-09-21T13:58:13.972457+0000","last_became_active":"2024-09-21T13:58:11.950788+0000","last_became_peered":"2024-09-21T13:58:11.950788+0000","last_unstale":"2024-09-21T13:58:13.972457+0000","last_undegraded":"2024-09-21T13:58:13.972457+0000","last_fullsized":"2024-09-21T13:58:13.972457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.420761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054402300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261067+0000","last_change":"2024-09-21T13:58:14.261067+0000","last_active":"2024-09-21T13:58:14.261067+0000","last_peered":"2024-09-21T13:58:14.261067+0000","last_clean":"2024-09-21T13:58:14.261067+0000","last_became_active":"2024-09-21T13:58:11.955637+0000","last_became_peered":"2024-09-21T13:58:11.955637+0000","last_unstale":"2024-09-21T13:58:14.261067+0000","last_undegraded":"2024-09-21T13:58:14.261067+0000","last_fullsized":"2024-09-21T13:58:14.261067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:37.122435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972806+0000","last_change":"2024-09-21T13:58:13.972806+0000","last_active":"2024-09-21T13:58:13.972806+0000","last_peered":"2024-09-21T13:58:13.972806+0000","last_clean":"2024-09-21T13:58:13.972806+0000","last_became_active":"2024-09-21T13:58:11.955126+0000","last_became_peered":"2024-09-21T13:58:11.955126+0000","last_unstale":"2024-09-21T13:58:13.972806+0000","last_undegraded":"2024-09-21T13:58:13.972806+0000","last_fullsized":"2024-09-21T13:58:13.972806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:29.039520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T13:58:12.958106+0000","last_change":"2024-09-21T13:58:06.893092+0000","last_active":"2024-09-21T13:58:12.958106+0000","last_peered":"2024-09-21T13:58:12.958106+0000","last_clean":"2024-09-21T13:58:12.958106+0000","last_became_active":"2024-09-21T13:58:06.892337+0000","last_became_peered":"2024-09-21T13:58:06.892337+0000","last_unstale":"2024-09-21T13:58:12.958106+0000","last_undegraded":"2024-09-21T13:58:12.958106+0000","last_fullsized":"2024-09-21T13:58:12.958106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:24.144363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:58:18.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:58:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:19.229 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:58:19.248 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-21T13:58:19.121754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219032,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755688,"statfs":{"total":773094113280,"available":772869824512,"internally_reserved":0,"allocated":2932736,"data_stored":1769022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.175192"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.119109+0000","last_change":"2024-09-21T13:58:14.119109+0000","last_active":"2024-09-21T13:58:14.119109+0000","last_peered":"2024-09-21T13:58:14.119109+0000","last_clean":"2024-09-21T13:58:14.119109+0000","last_became_active":"2024-09-21T13:58:11.960695+0000","last_became_peered":"2024-09-21T13:58:11.960695+0000","last_unstale":"2024-09-21T13:58:14.119109+0000","last_undegraded":"2024-09-21T13:58:14.119109+0000","last_fullsized":"2024-09-21T13:58:14.119109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:37.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965360+0000","last_change":"2024-09-21T13:58:13.965360+0000","last_active":"2024-09-21T13:58:13.965360+0000","last_peered":"2024-09-21T13:58:13.965360+0000","last_clean":"2024-09-21T13:58:13.965360+0000","last_became_active":"2024-09-21T13:58:11.955322+0000","last_became_peered":"2024-09-21T13:58:11.955322+0000","last_unstale":"2024-09-21T13:58:13.965360+0000","last_undegraded":"2024-09-21T13:58:13.965360+0000","last_fullsized":"2024-09-21T13:58:13.965360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:38:29.040695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071457400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261122+0000","last_change":"2024-09-21T13:58:14.261122+0000","last_active":"2024-09-21T13:58:14.261122+0000","last_peered":"2024-09-21T13:58:14.261122+0000","last_clean":"2024-09-21T13:58:14.261122+0000","last_became_active":"2024-09-21T13:58:12.178049+0000","last_became_peered":"2024-09-21T13:58:12.178049+0000","last_unstale":"2024-09-21T13:58:14.261122+0000","last_undegraded":"2024-09-21T13:58:14.261122+0000","last_fullsized":"2024-09-21T13:58:14.261122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:56.580072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.965696+0000","last_change":"2024-09-21T13:58:13.965696+0000","last_active":"2024-09-21T13:58:13.965696+0000","last_peered":"2024-09-21T13:58:13.965696+0000","last_clean":"2024-09-21T13:58:13.965696+0000","last_became_active":"2024-09-21T13:58:12.177138+0000","last_became_peered":"2024-09-21T13:58:12.177138+0000","last_unstale":"2024-09-21T13:58:13.965696+0000","last_undegraded":"2024-09-21T13:58:13.965696+0000","last_fullsized":"2024-09-21T13:58:13.965696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.103500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075207099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.975129+0000","last_change":"2024-09-21T13:58:13.973999+0000","last_active":"2024-09-21T13:58:13.975129+0000","last_peered":"2024-09-21T13:58:13.975129+0000","last_clean":"2024-09-21T13:58:13.975129+0000","last_became_active":"2024-09-21T13:58:11.956462+0000","last_became_peered":"2024-09-21T13:58:11.956462+0000","last_unstale":"2024-09-21T13:58:13.975129+0000","last_undegraded":"2024-09-21T13:58:13.975129+0000","last_fullsized":"2024-09-21T13:58:13.975129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:20:15.859666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972457+0000","last_change":"2024-09-21T13:58:13.972457+0000","last_active":"2024-09-21T13:58:13.972457+0000","last_peered":"2024-09-21T13:58:13.972457+0000","last_clean":"2024-09-21T13:58:13.972457+0000","last_became_active":"2024-09-21T13:58:11.950788+0000","last_became_peered":"2024-09-21T13:58:11.950788+0000","last_unstale":"2024-09-21T13:58:13.972457+0000","last_undegraded":"2024-09-21T13:58:13.972457+0000","last_fullsized":"2024-09-21T13:58:13.972457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.420761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054402300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.261067+0000","last_change":"2024-09-21T13:58:14.261067+0000","last_active":"2024-09-21T13:58:14.261067+0000","last_peered":"2024-09-21T13:58:14.261067+0000","last_clean":"2024-09-21T13:58:14.261067+0000","last_became_active":"2024-09-21T13:58:11.955637+0000","last_became_peered":"2024-09-21T13:58:11.955637+0000","last_unstale":"2024-09-21T13:58:14.261067+0000","last_undegraded":"2024-09-21T13:58:14.261067+0000","last_fullsized":"2024-09-21T13:58:14.261067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:37.122435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:13.972806+0000","last_change":"2024-09-21T13:58:13.972806+0000","last_active":"2024-09-21T13:58:13.972806+0000","last_peered":"2024-09-21T13:58:13.972806+0000","last_clean":"2024-09-21T13:58:13.972806+0000","last_became_active":"2024-09-21T13:58:11.955126+0000","last_became_peered":"2024-09-21T13:58:11.955126+0000","last_unstale":"2024-09-21T13:58:13.972806+0000","last_undegraded":"2024-09-21T13:58:13.972806+0000","last_fullsized":"2024-09-21T13:58:13.972806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:29.039520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-21T13:58:12.958106+0000","last_change":"2024-09-21T13:58:06.893092+0000","last_active":"2024-09-21T13:58:12.958106+0000","last_peered":"2024-09-21T13:58:12.958106+0000","last_clean":"2024-09-21T13:58:12.958106+0000","last_became_active":"2024-09-21T13:58:06.892337+0000","last_became_peered":"2024-09-21T13:58:06.892337+0000","last_unstale":"2024-09-21T13:58:12.958106+0000","last_undegraded":"2024-09-21T13:58:12.958106+0000","last_fullsized":"2024-09-21T13:58:12.958106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:24.144363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":73550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":663899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:58:19.249 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T13:58:19.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 22 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:fsid af11199c-39d9-4003-9df0-1f9fd66ab792 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-21T13:57:52.430765+0000 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-21T13:58:17.139590+0000 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T13:58:19.531 INFO:teuthology.orchestra.run.smithi079.stdout:crush_version 4 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:full_ratio 0.95 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:backfillfull_ratio 0.9 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:nearfull_ratio 0.85 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:require_min_compat_client luminous 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:min_compat_client jewel 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:require_osd_release reef 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:stretch_mode_enabled false 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:max_osd 8 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/3285725925,v1:172.21.15.79:6818/3285725925] [v2:172.21.15.79:6820/3285725925,v1:172.21.15.79:6823/3285725925] exists,up 4f3cec52-e90a-4dc6-8a9d-879659a7f8b3 2024-09-21T13:58:19.532 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6817/1533952849,v1:172.21.15.79:6819/1533952849] [v2:172.21.15.79:6821/1533952849,v1:172.21.15.79:6822/1533952849] exists,up f30fdaae-2baf-49e5-b8c2-24477eabf5c6 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/3403916996,v1:172.21.15.79:6801/3403916996] [v2:172.21.15.79:6802/3403916996,v1:172.21.15.79:6803/3403916996] exists,up 54acbaba-89a5-4b6c-bd93-89e0683f2125 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/3937234571,v1:172.21.15.79:6809/3937234571] [v2:172.21.15.79:6810/3937234571,v1:172.21.15.79:6811/3937234571] exists,up 76fc66bf-6186-4666-b92f-c8093d20d625 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/3468135680,v1:172.21.15.134:6825/3468135680] [v2:172.21.15.134:6826/3468135680,v1:172.21.15.134:6827/3468135680] exists,up c90b7f74-168e-4c89-b1cf-c9ce463afa6e 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/3245816486,v1:172.21.15.134:6817/3245816486] [v2:172.21.15.134:6818/3245816486,v1:172.21.15.134:6819/3245816486] exists,up b837d993-44f1-4dd3-99f7-675e6abcd9c7 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2399307560,v1:172.21.15.134:6809/2399307560] [v2:172.21.15.134:6810/2399307560,v1:172.21.15.134:6811/2399307560] exists,up c68ceefc-f355-4f66-870e-95ce4a9bc37e 2024-09-21T13:58:19.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2163234632,v1:172.21.15.134:6801/2163234632] [v2:172.21.15.134:6802/2163234632,v1:172.21.15.134:6803/2163234632] exists,up e1909a46-859c-45e8-b84b-0e11db556c48 2024-09-21T13:58:19.548 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/3285725925,v1:172.21.15.79:6818/3285725925] [v2:172.21.15.79:6820/3285725925,v1:172.21.15.79:6823/3285725925] exists,up 4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6817/1533952849,v1:172.21.15.79:6819/1533952849] [v2:172.21.15.79:6821/1533952849,v1:172.21.15.79:6822/1533952849] exists,up f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/3403916996,v1:172.21.15.79:6801/3403916996] [v2:172.21.15.79:6802/3403916996,v1:172.21.15.79:6803/3403916996] exists,up 54acbaba-89a5-4b6c-bd93-89e0683f2125', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/3937234571,v1:172.21.15.79:6809/3937234571] [v2:172.21.15.79:6810/3937234571,v1:172.21.15.79:6811/3937234571] exists,up 76fc66bf-6186-4666-b92f-c8093d20d625', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/3468135680,v1:172.21.15.134:6825/3468135680] [v2:172.21.15.134:6826/3468135680,v1:172.21.15.134:6827/3468135680] exists,up c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/3245816486,v1:172.21.15.134:6817/3245816486] [v2:172.21.15.134:6818/3245816486,v1:172.21.15.134:6819/3245816486] exists,up b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/2399307560,v1:172.21.15.134:6809/2399307560] [v2:172.21.15.134:6810/2399307560,v1:172.21.15.134:6811/2399307560] exists,up c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2163234632,v1:172.21.15.134:6801/2163234632] [v2:172.21.15.134:6802/2163234632,v1:172.21.15.134:6803/2163234632] exists,up e1909a46-859c-45e8-b84b-0e11db556c48'] 2024-09-21T13:58:19.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mon.a", 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster": "ceph", 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "admin_socket_mode": "", 2024-09-21T13:58:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_client_required": "cephx, none", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_cluster_required": "cephx", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_debug": "true", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_service_required": "cephx", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_supported": "cephx", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio": "true", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_poll_ms": "250", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_reap_max": "16", 2024-09-21T13:58:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_async_discard": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_block_size": "4096", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_inflight_ios": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_enable_discard": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_flock_retry": "3", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_inject_crash": "0", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring_hipri": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-21T13:58:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_type": "", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_alloc_size": "1048576", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_allocator": "hybrid", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_buffered_io": "true", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_for_zeros": "false", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_compact_log_sync": "false", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-21T13:58:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_max_log_runway": "4194304", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_max_prefetch": "1048576", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_min_flush_size": "524288", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_min_log_runway": "1048576", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_replay_recovery": "false", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_sync_write": "false", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-21T13:58:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_allocation_from_file": "true", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_allocator": "hybrid", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_create": "true", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_create": "false", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_path": "", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_size": "0", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_path": "", 2024-09-21T13:58:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_preallocate_file": "false", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_size": "107374182400", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_create": "false", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_path": "", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_size": "100663296", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs": "true", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-21T13:58:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_autotune": "true", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size": "0", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_type": "2q", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-21T13:58:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_clone_cow": "true", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_mode": "none", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_csum_type": "crc32c", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_freelist": "false", 2024-09-21T13:58:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-21T13:58:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_small_allocations": "0", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_default_buffered_read": "true", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_default_buffered_write": "false", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fail_eio": "false", 2024-09-21T13:58:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mount": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_umount": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-21T13:58:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_ignore_data_csum": "false", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_op_age": "5.000000", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_alloc_size": "0", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size": "0", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-21T13:58:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_deferred_txc": "32", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size": "0", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_nid_prealloc": "1024", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_retry_disk_reads": "3", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_cf": "true", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-21T13:58:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_mem": "512", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_tracing": "false", 2024-09-21T13:58:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_zero_block_detection": "false", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-21T13:58:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_cluster_require_signatures": "false", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_cluster_require_version": "2", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_require_signatures": "false", 2024-09-21T13:58:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_require_version": "2", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_service_require_signatures": "false", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_service_require_version": "2", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_sign_messages": "true", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "chdir": "", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_acl_type": "", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_asio_thread_count": "2", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_cache_mid": "0.750000", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_cache_size": "16384", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_caps_release_delay": "5", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_check_pool_perm": "true", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_force_sync_read": "false", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_getattr_caps": "false", 2024-09-21T13:58:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_inject_features": "", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_inject_tick_delay": "0", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_die_on_failed_remount": "false", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_dirsize_rbytes": "true", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_force_lazyio": "false", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_fs": "", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_inject_release_failure": "false", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_max_inline_size": "4096", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mds_namespace": "", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_metadata": "", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_gid": "-1", 2024-09-21T13:58:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_timeout": "300", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_uid": "-1", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mountpoint": "/", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_notify_timeout": "10", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc": "true", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_dirty": "104857600", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_objects": "1000", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_size": "209715200", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_target_dirty": "8388608", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_permissions": "true", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_quota": "true", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_quota_df": "true", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_max_bytes": "0", 2024-09-21T13:58:19.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_max_periods": "4", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_min": "131072", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_reconnect_stale": "false", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_shutdown_timeout": "30", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_snapdir": ".snap", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_tick_interval": "1", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_trace": "", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_try_dentry_invalidate": "false", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_use_faked_inos": "false", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_use_random_mds": "false", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog": "false", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog_port": "12201", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_monitors": "default=true", 2024-09-21T13:58:19.687 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog": "false", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog_level": "info", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "-", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_network": "", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_network_interface": "", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_isal": "false", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_level": "5", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_winsize": "-15", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zstd_level": "1", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_alien_op_num_threads": "6", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-21T13:58:19.688 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_seastar_smp": "1", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location": "", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location_hook": "", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location_hook_timeout": "10", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "daemonize": "false", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "daos_pool": "tank", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_alienstore": "0/5", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_allow_any_pool_priority": "false", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asok": "1/5", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asok_assert_abort": "false", 2024-09-21T13:58:19.689 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asserts_on_shutdown": "true", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_auth": "20/20", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bdev": "1/3", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bluefs": "1/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bluestore": "1/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_buffer": "0/1", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_ceph_exporter": "1/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cephfs_mirror": "0/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cephsqlite": "0/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_client": "0/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_compressor": "1/5", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_context": "0/1", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_crush": "1/1", 2024-09-21T13:58:19.690 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_crypto": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cyanstore": "0/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_deliberately_leak_memory": "false", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_disable_randomized_ping": "false", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_dpdk": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_eventtrace": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_filer": "0/1", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_filestore": "1/3", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_finisher": "1/1", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_fuse": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_heartbeat_testing_span": "0", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_heartbeatmap": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_javaclient": "1/5", 2024-09-21T13:58:19.691 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_journal": "1/3", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_journaler": "0/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_kstore": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_leveldb": "4/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_lockdep": "0/1", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mclock": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_balancer": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_locker": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_log": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_log_expire": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_migrator": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_memstore": "1/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mgr": "2/5", 2024-09-21T13:58:19.692 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mgrc": "1/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mon": "20/20", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_monc": "0/10", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_ms": "1/1", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_none": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objclass": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objectcacher": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objecter": "0/1", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_optracker": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_osd": "1/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_paxos": "20/20", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_perfcounter": "1/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_prioritycache": "1/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rados": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd": "0/5", 2024-09-21T13:58:19.693 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_mirror": "0/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_pwl": "0/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_replay": "0/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_refs": "0/0", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_reserver": "1/1", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_access": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_datacache": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_dbstore": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_flight": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_sync": "1/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rocksdb": "4/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore": "0/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_backref": "0/5", 2024-09-21T13:58:19.694 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_cache": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_cleaner": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_device": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_epm": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_journal": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_lba": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_odata": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_omap": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_onode": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_t": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_tm": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_striper": "0/1", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_test": "0/5", 2024-09-21T13:58:19.695 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_throttle": "1/1", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_timer": "0/1", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_tp": "0/5", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "device_failure_prediction_mode": "none", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_graylog": "false", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_journald": "false", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_stderr": "true", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_syslog": "false", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event_tracing": "false", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_addr": "0.0.0.0", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_http_port": "9926", 2024-09-21T13:58:19.696 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_prio_limit": "5", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_sort_metrics": "true", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_stats_period": "5", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "fake_statfs_for_testing": "0", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "fatal_signal_handlers": "true", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filer_max_purge_ops": "10", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filer_max_truncate_ops": "128", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_apply_finisher_threads": "1", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_blackhole": "false", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_btrfs_clone_range": "true", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_btrfs_snap": "true", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_caller_concurrency": "10", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_collect_device_partition_information": "true", 2024-09-21T13:58:19.697 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_commit_timeout": "600.000000", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_inject_read_err": "false", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_omap_check": "false", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_verify_split": "false", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_dump_file": "", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fadvise": "true", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fail_eio": "true", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fd_cache_shards": "16", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fd_cache_size": "128", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fiemap": "false", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fiemap_threshold": "4096", 2024-09-21T13:58:19.698 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_inject_stall": "0", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_parallel": "false", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_trailing": "false", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_writeahead": "false", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_kill_at": "0", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs": "0", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-21T13:58:19.699 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size": "0", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_merge_threshold": "-10", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_odsync_write": "false", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_backend": "rocksdb", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_backend_path": "", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-21T13:58:19.700 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_thread_timeout": "60", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_threads": "2", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_punch_hole": "false", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-21T13:58:19.701 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_ops": "50", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_seek_data_hole": "false", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_sloppy_crc": "false", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_splice": "false", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_split_multiple": "2", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_split_rand_factor": "20", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_update_to": "1000", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-21T13:58:19.702 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_enable": "true", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_xfs_extsize": "false", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_zfs_snap": "false", 2024-09-21T13:58:19.703 INFO:teuthology.orchestra.run.smithi079.stdout: "fio_dir": "/tmp/fio", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_allow_other": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_atomic_o_trunc": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_big_writes": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_debug": "false", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_default_permissions": "false", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_disable_pagecache": "false", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_max_write": "0", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_multithreaded": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_require_active_mds": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_set_user_groups": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_move": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_read": "true", 2024-09-21T13:58:19.704 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_write": "true", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_use_invalidate_cb": "true", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "gss_target_name": "ceph", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_file": "", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_inject_failure": "0", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_interval": "5", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "host": "smithi079", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-21T13:58:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "inject_early_sigterm": "false", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "jaeger_agent_port": "6799", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "jaeger_tracing_enable": "false", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_aio": "true", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_align_min_size": "65536", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_block_align": "true", 2024-09-21T13:58:19.706 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_block_size": "4096", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_dio": "true", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_discard": "false", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_force_aio": "false", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_ignore_corruption": "false", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_max_write_bytes": "10485760", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_max_write_entries": "100", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_replay_from": "0", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_write_header_frequency": "0", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_zero_on_create": "false", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_prefetch_periods": "10", 2024-09-21T13:58:19.707 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_prezero_periods": "5", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_write_head_interval": "15", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "keyfile": "", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_backend": "rocksdb", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_default_stripe_size": "65536", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_fsck_on_mount": "false", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_max_bytes": "67108864", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_max_ops": "512", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_nid_prealloc": "1024", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_onode_map_size": "1024", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-21T13:58:19.708 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_sync_submit_transaction": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_sync_transaction": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_block_size": "65536", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_bloom_size": "0", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_cache_size": "536870912", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_compact_on_mount": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_compression": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_log": "", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_max_open_files": "0", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_paranoid": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "librados_thread_count": "2", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "lockdep": "false", 2024-09-21T13:58:19.709 INFO:teuthology.orchestra.run.smithi079.stdout: "lockdep_force_backtrace": "false", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_coarse_timestamps": "true", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_flush_on_exit": "false", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_graylog_host": "127.0.0.1", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_graylog_port": "12201", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_max_new": "1000", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_max_recent": "10000", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_stderr_prefix": "", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_stop_at_utilization": "0.970000", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": "true", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_graylog": "false", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_journald": "false", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_stderr": "false", 2024-09-21T13:58:19.710 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_syslog": "false", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "max_rotating_auth_attempts": "10", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_action_on_write_error": "1", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_alternate_name_max": "8192", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_asio_thread_count": "2", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_export_pin": "true", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_dirs": "true", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-21T13:58:19.711 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_interval": "5", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_interval": "10", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_max": "-1", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_max_until": "-1", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_merge_size": "50", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_midchunk": "0.300000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_min_start": "0.200000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_minchunk": "0.001000", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_mode": "0", 2024-09-21T13:58:19.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_need_max": "1.200000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_need_min": "0.800000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_bits": "3", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_size": "10000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_target_decay": "10.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_grace": "15.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_interval": "4.000000", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-21T13:58:19.713 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_mid": "0.700000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_release_free_interval": "10", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_reservation": "0.050000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_interval": "1", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_threshold": "262144", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_prealloc_inos": "1000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_connect_bootstrapping": "false", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_damage_table_max_entries": "10000", 2024-09-21T13:58:19.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_auth_pins": "false", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_frag": "false", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_scatterstat": "false", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_subtrees": "false", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_decay_halflife": "5.000000", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_default_dir_hash": "2", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_defer_session_stale": "true", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_deny_all_reconnect": "false", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_keys_per_op": "16384", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_max_commit_size": "10", 2024-09-21T13:58:19.715 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_max_entries": "0", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_prefetch": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_on_map": "false", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_early_reply": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_enable_op_tracker": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_enforce_unique_name": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_random": "true", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-21T13:58:19.716 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_health_summarize_threshold": "10", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_health_dummy": "false", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_migrator_session_race": "false", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-21T13:58:19.717 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_join_fs": "", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_journal_format": "1", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_create_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_export_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_import_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_expire_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_replay_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_link_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_mdstable_at": "0", 2024-09-21T13:58:19.718 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_openc_at": "0", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_rename_at": "0", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_events_per_segment": "1024", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_max_events": "-1", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_max_segments": "128", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_pause": "false", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_segment_size": "0", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_warn_factor": "2.000000", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_caps_per_client": "1048576", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_completed_flushes": "100000", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_completed_requests": "100000", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_export_size": "20971520", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_file_recover": "32", 2024-09-21T13:58:19.719 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_files": "64", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_ops": "8192", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_snaps_per_dir": "100", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_metrics_update_interval": "2", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_min_caps_per_client": "100", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_min_caps_working_set": "10000", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_numa_node": "-1", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_complaint_time": "30.000000", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_duration": "600", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_size": "20", 2024-09-21T13:58:19.720 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_slow_op_size": "20", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_log_threshold": "5", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_ping_grace": "15", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_ping_interval": "5", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_caps": "30000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_warning_threshold": "262144", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_replay_interval": "1.000000", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-21T13:58:19.721 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_root_ino_gid": "0", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_root_ino_uid": "0", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-21T13:58:19.722 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_shutdown_check": "0", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_skip_ino": "0", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_max_uid": "4294967294", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_min_uid": "0", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_rstat": "false", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_standby_replay_damaged": "false", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_symlink_recovery": "true", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_thrash_exports": "0", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_thrash_fragments": "0", 2024-09-21T13:58:19.723 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_tick_interval": "5.000000", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_valgrind_exit": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_verify_backtrace": "1", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_verify_scatter": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_wipe_sessions": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool_debug": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_device_bytes": "1073741824", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_page_set": "false", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_page_size": "65536", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_bytes": "134217728", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_messages": "512", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-21T13:58:19.724 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_disabled_modules": "", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_max_pg_num_change": "128", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mds_bytes": "134217728", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mds_messages": "128", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mon_bytes": "134217728", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mon_messages": "128", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_osd_bytes": "536870912", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_osd_messages": "8192", 2024-09-21T13:58:19.725 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_pool": "true", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_standby_modules": "true", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_stats_period": "5", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_stats_threshold": "5", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_tick_period": "2", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_allow_pool_delete": "true", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_allow_pool_size_one": "true", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_auth_validate_all_caps": "true", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-21T13:58:19.726 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_bytes": "104857600", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_directed_command_retry": "5", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_parallel": "3", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_log_interval": "1.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_ping_interval": "10.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-21T13:58:19.727 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_file_level": "debug", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_file": "true", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_journald": "false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_bootstrap": "false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_start": "false", 2024-09-21T13:58:19.728 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_trim": "true", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cpu_threads": "4", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_crush_min_required_version": "hammer", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_daemon_bytes": "419430400", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_avail_crit": "5", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_avail_warn": "5", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_size_warn": "16106127360", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_json": "false", 2024-09-21T13:58:19.729 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_transactions": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_extra_checks": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_quincy": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_reef": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_down_mkfs_grace": "120", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_election_default_strategy": "1", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_election_timeout": "5.000000", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-21T13:58:19.730 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ping_divisor": "2", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_enable_op_tracker": "true", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_fake_pool_delete": "false", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_force_quorum_join": "false", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_globalid_prealloc": "10000", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_detail_to_clog": "false", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_log_update_period": "5", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_max_detail": "50", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog": "true", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog_interval": "600", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_host": "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.134", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_host_override": "", 2024-09-21T13:58:19.731 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_initial_members": "", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease": "5.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_full_interval": "50", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_max": "10000", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_max_summary": "50", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-21T13:58:19.732 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_log_epochs": "500", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_osd": "10000", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_pg_per_osd": "10000", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_pool_pg_num": "65536", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_force_trim_to": "0", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_skip_sanity": "false", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_memory_autotune": "true", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_memory_target": "2147483648", 2024-09-21T13:58:19.733 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_beacon_grace": "30", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_digest_period": "5", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_inactive_grace": "60", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_min_osdmap_epochs": "500", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_complaint_time": "30", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_duration": "600", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_size": "20", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_slow_op_size": "20", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_log_threshold": "5", 2024-09-21T13:58:19.734 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_in": "false", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_cache_size": "500", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_down_out_interval": "600", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-21T13:58:19.735 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_force_trim_to": "0", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_down_reporters": "2", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-21T13:58:19.736 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_report_timeout": "900", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_stuck_threshold": "60", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-21T13:58:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_probe_timeout": "2.000000", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_max_change": "0.050000", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_max_osds": "4", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_interval": "86400", 2024-09-21T13:58:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_max_keys": "100", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_timeout": "300", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_session_timeout": "300", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_smart_report_timeout": "5", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stat_smooth_intervals": "6", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_pool_min_size": "2", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_pool_size": "4", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_debug": "false", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_provider_kill_at": "0", 2024-09-21T13:58:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_requester_kill_at": "0", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_timeout": "60.000000", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_target_pg_per_osd": "100", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_tick_interval": "5", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_timecheck_interval": "300.000000", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_use_min_delay_socket": "false", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_older_version_delay": "604800", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-21T13:58:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_misplaced": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_older_version": "true", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-21T13:58:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "monmap": "", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_tracing_enabled": "false", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_op_threads": "3", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_cm": "false", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_device_name": "", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_dscp": "96", 2024-09-21T13:58:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_local_gid": "", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_port_num": "1", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_sl": "3", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_support_srq": "true", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_type": "ib", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_reap_threshold": "5", 2024-09-21T13:58:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_before_connect": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_ipv4": "true", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_ipv6": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_msgr1": "true", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_msgr2": "true", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_port_max": "7568", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_port_min": "6800", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_retry_count": "3", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_retry_delay": "5", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_client": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mds": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mgr": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mon": "false", 2024-09-21T13:58:19.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_osd": "false", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_client_mode": "crc secure", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_cluster_mode": "crc secure", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_cluster_type": "", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_compress_secure": "false", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_connection_idle_timeout": "900", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_connection_ready_timeout": "10", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_crc_data": "true", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_crc_header": "true", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_bad_msg": "false", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_bug": "true", 2024-09-21T13:58:19.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_old_message": "true", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_skipped_message": "false", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_coremask": "0xF", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_enable_tso": "true", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hugepages": "", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_lro": "true", 2024-09-21T13:58:19.746 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_memory_channel": "4", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_pmd": "", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_port_id": "0", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dump_on_send": "false", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_initial_backoff": "0.200000", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_max": "1.000000", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_type": "", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_network_congestion": "0", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_socket_failures": "5000", 2024-09-21T13:58:19.747 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_learn_addr_from_peer": "true", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_max_accept_failures": "4", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_max_backoff": "15.000000", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_client_mode": "secure crc", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_service_mode": "secure crc", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compress_min_size": "1024", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compress_mode": "none", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_pq_min_cost": "65536", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_public_type": "", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_service_mode": "crc secure", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_listen_backlog": "512", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_nodelay": "true", 2024-09-21T13:58:19.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_rcvbuf": "0", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_type": "async+posix", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "no_config_file": "false", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_completion_locks_per_session": "32", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inflight_ops": "1024", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_tick_interval": "5.000000", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_timeout": "10.000000", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "objectstore_blackhole": "false", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "openssl_engine_opts": "", 2024-09-21T13:58:19.749 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_delay_time": "5.000000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_hist_halflife": "1000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_max_low_ops": "2", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_max_ops": "4", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_slop": "0.020000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_asio_thread_count": "2", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_async_recovery_min_cost": "100", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-21T13:58:19.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_scan_max": "512", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_scan_min": "64", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_degraded": "false", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_peering": "false", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_unfound": "true", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_beacon_report_interval": "300", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_duration": "30", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_max_block_size": "67108864", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_blkin_trace_all": "false", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-21T13:58:19.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_check_for_log_corruption": "false", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_update_on_start": "true", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_message_cap": "256", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_message_size_cap": "524288000", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_op_priority": "63", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_watch_timeout": "30", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_command_max_records": "256", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_compact_on_start": "false", 2024-09-21T13:58:19.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_update_on_start": "true", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_update_weight_set": "true", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_feed_pullee": "-1", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-21T13:58:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_misdirected_ops": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_no_acting_change": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_no_purge_strays": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_op_order": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_shutdown": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_snaps": "false", 2024-09-21T13:58:19.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_keys": "1024", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_stride": "524288", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_default_notify_timeout": "30", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep": "0.000000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-21T13:58:19.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_discard_disconnected_ops": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_enable_op_tracker": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_info": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_function_tracing": "false", 2024-09-21T13:58:19.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_grace": "20", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_interval": "6", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_peers": "10", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_size": "2000", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_stale": "600", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_max_size": "100000", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_min_size": "1000", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-21T13:58:19.757 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal_size": "5120", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_kill_backfill_at": "0", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_cache_size": "50", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_dedup": "true", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_message_max": "40", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_share_max_epochs": "40", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_attr_name_len": "100", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_attr_size": "0", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_backfills": "1", 2024-09-21T13:58:19.758 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_markdown_count": "5", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_markdown_period": "600", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_name_len": "2048", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_namespace_len": "256", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_size": "134217728", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_blocked_by": "16", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_log_entries": "10000", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pgls": "1024", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_push_cost": "8388608", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_push_objects": "10", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_scrubs": "3", 2024-09-21T13:58:19.759 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_trimming_pgs": "2", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_write_op_reply_len": "64", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_write_size": "90", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_profile": "balanced", 2024-09-21T13:58:19.760 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_base": "805306368", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_cache_min": "134217728", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-21T13:58:19.761 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target": "4294967296", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target_autotune": "false", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_min_pg_log_entries": "250", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_min_recovery_priority": "0", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_report_interval": "5", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_num_cache_shards": "32", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_num_op_tracker_shard": "32", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_auto_affinity": "true", 2024-09-21T13:58:19.762 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_node": "-1", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_prefer_iface": "true", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objecter_finishers": "1", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore": "bluestore", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore_fuse": "false", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore_tracing": "false", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_complaint_time": "30.000000", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_duration": "600", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_size": "20", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_slow_op_size": "20", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_log_threshold": "5", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards": "0", 2024-09-21T13:58:19.763 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards_hdd": "5", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards_ssd": "8", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_pq_min_cost": "65536", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_queue_cut_off": "high", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_thread_timeout": "15", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_open_classes_on_start": "true", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_os_flags": "0", 2024-09-21T13:58:19.764 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_peering_op_priority": "255", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_delete_cost": "1048576", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_delete_priority": "5", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_trim_max": "10000", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_trim_min": "100", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-21T13:58:19.765 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_crimson": "false", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-21T13:58:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flags": "0", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_min_size": "0", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pg_num": "32", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pgp_num": "0", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_size": "2", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_type": "replicated", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_push_per_object_cost": "1000", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-21T13:58:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recover_clone_overlap": "true", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_cost": "20971520", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active": "0", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_single_start": "1", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_op_priority": "3", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_priority": "5", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-21T13:58:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep": "0.000000", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_repair_during_recovery": "false", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_requested_scrub_priority": "120", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_auto_repair": "false", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_begin_hour": "0", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_begin_week_day": "0", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_chunk_max": "25", 2024-09-21T13:58:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_chunk_min": "5", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_cost": "52428800", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_during_recovery": "false", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_end_hour": "0", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_end_week_day": "0", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_event_cost": "4096", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_invalid_stats": "true", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_max_preemptions": "5", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_priority": "5", 2024-09-21T13:58:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_reservation_timeout": "5000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_sleep": "0.000000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_skip_data_digest": "false", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_smart_report_timeout": "5", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_cost": "1048576", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_priority": "5", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-21T13:58:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_target_transaction_size": "30", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tracing": "false", 2024-09-21T13:58:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_use_stale_snap": "false", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "osdc_blkin_trace_all": "false", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_kill_at": "0", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_max_join_drift": "10", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_min": "500", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_min_wait": "0.050000", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_propose_interval": "1.000000", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_max": "500", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_min": "250", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_stash_full_interval": "25", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_trim_max": "500", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_trim_min": "250", 2024-09-21T13:58:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "perf": "true", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "-", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrv": "", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "public_bind_addr": "-", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "public_network": "", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "public_network_interface": "", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "qat_compressor_enabled": "false", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "qat_compressor_session_max_number": "256", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_mon_op_timeout": "0", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_osd_op_timeout": "0", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_tracing": "false", 2024-09-21T13:58:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_atime_update_interval": "60", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_balance_parent_reads": "false", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_balance_snap_reads": "false", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blkin_trace_all": "false", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache": "true", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_policy": "writearound", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_size": "33554432", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-21T13:58:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_clone_copy_on_read": "false", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_compression_hint": "none", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_concurrent_management_ops": "10", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_clone_format": "auto", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_data_pool": "", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_features": "61", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_format": "2", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_map_options": "", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_order": "22", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_pool": "rbd", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_stripe_count": "0", 2024-09-21T13:58:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_stripe_unit": "0", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_enable_alloc_hint": "true", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_io_scheduler": "simple", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-21T13:58:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_order": "24", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_pool": "", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_splay_width": "4", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_localize_parent_reads": "false", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_localize_snap_reads": "false", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-21T13:58:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-21T13:58:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mtime_update_interval": "60", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_non_blocking_aio": "true", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_op_thread_timeout": "60", 2024-09-21T13:58:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_op_threads": "1", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_parent_cache_enabled": "false", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_plugins": "", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_burst": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_limit": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_exclude_ops": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_burst": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_limit": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-21T13:58:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_read_from_replica_policy": "default", 2024-09-21T13:58:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_skip_partial_discard": "true", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_tracing": "false", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_validate_names": "true", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_validate_pool": "true", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "restapi_base_url": "", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "restapi_log_level": "", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_acl_grants_max_num": "100", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_admin_entry": "admin", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-21T13:58:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_backend_store": "rados", 2024-09-21T13:58:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_barbican_url": "", 2024-09-21T13:58:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_beast_enable_async": "true", 2024-09-21T13:58:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-21T13:58:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-21T13:58:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-21T13:58:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-21T13:58:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-21T13:58:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-21T13:58:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_enabled": "true", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_expiry_interval": "900", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_lru_size": "10000", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_config_store": "rados", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_content_length_compat": "false", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_copy_obj_progress": "true", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cors_rules_max_num": "100", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cross_domain_policy": "", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_addr": "", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-21T13:58:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_password": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_username": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_require_ssl": "true", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-21T13:58:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_addr": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_auth": "token", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_namespace": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_prefix": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-21T13:58:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_token_file": "", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_buffersize": "524288", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_low_speed_time": "300", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-21T13:58:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_changes_size": "1000", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_num_shards": "128", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_window": "30", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-21T13:58:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-21T13:58:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dns_name": "", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dns_s3website_name": "", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dynamic_resharding": "true", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_gc_threads": "true", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_lc_threads": "true", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_ops_log": "false", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_quota_threads": "true", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_static_website": "false", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_usage_log": "false", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enforce_swift_acls": "true", 2024-09-21T13:58:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_exit_timeout_secs": "120", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_expose_bucket": "false", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_extended_http_attrs": "", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_filter": "none", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_frontends": "beast port=7480", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_deferred": "50", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_objs": "32", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-21T13:58:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_processor_period": "3600", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_init_timeout": "300", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_domain": "", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_password": "", 2024-09-21T13:58:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_password_path": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_project": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_tenant": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_token": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_token_path": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_user": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_api_version": "2", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_domain": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_password": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_project": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_user": "", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-21T13:58:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_url": "", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_debug_interval": "-1", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_lock_max_time": "90", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_objs": "32", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_rules": "1000", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_worker": "3", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_thread_delay": "0", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_dnattr": "uid", 2024-09-21T13:58:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_searchfilter": "", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_uri": "ldaps://", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_http_headers": "", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_object_name_utc": "false", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attr_name_len": "0", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attr_size": "0", 2024-09-21T13:58:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_chunk_size": "4194304", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_listing_results": "1000", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_notify_retries": "10", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_put_param_size": "1048576", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_put_size": "5368709120", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_slo_entries": "1000", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_md_log_max_shards": "64", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-21T13:58:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_mp_lock_max_time": "600", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_max_gc": "300", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-21T13:58:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_num_async_rados_threads": "32", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_num_control_oids": "8", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_numa_node": "-1", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_chunk_size": "100", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_gc_interval": "600", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-21T13:58:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_thread_timeout": "600", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_tracing": "false", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_token": "", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_url": "", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_verify_ssl": "true", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_rados": "false", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_socket_path": "", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_push_interval": "2.000000", 2024-09-21T13:58:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_print_continue": "true", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_tracing": "false", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm": "", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm_id": "", 2024-09-21T13:58:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_region": "", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_request_uri": "", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_batch_size": "64", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_max_aio": "128", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_num_logs": "16", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_thread_interval": "600", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_resolve_cname": "false", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-21T13:58:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_run_sync_thread": "true", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_scheduler_type": "throttler", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_script_uri": "", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_service_provider_name": "", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_client_id": "", 2024-09-21T13:58:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_client_secret": "", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_entry": "sts", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_key": "sts", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_min_session_duration": "900", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_token_introspection_url": "", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_account_in_url": "false", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_auth_entry": "auth", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_auth_url": "", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_custom_header": "", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_need_stats": "true", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_tenant_name": "", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_token_expiration": "86400", 2024-09-21T13:58:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_url": "", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_url_prefix": "swift", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_lease_period": "120", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-21T13:58:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_thread_pool_size": "512", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_comment": "", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_createby": "", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_encoding": "", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_flag": "false", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_origin": "", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_tracker": "", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_trust_forwarded_https": "false", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_max_shards": "32", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_max_user_shards": "1", 2024-09-21T13:58:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_use_opa_authz": "false", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_max_buckets": "1000", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_policies_max_num": "100", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_unique_email": "true", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_verify_ssl": "true", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone": "", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone_id": "", 2024-09-21T13:58:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup": "", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup_id": "", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rgwlc_auto_session_clear": "true", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_block_size": "4096", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_size": "536870912", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-21T13:58:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_index_type": "binary_search", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-21T13:58:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-21T13:58:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_partition_filters": "false", 2024-09-21T13:58:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_perf": "false", 2024-09-21T13:58:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-21T13:58:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-21T13:58:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "run_dir": "/var/run/ceph", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_block_create": "true", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_cache_lru_size": "67108864", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_default_max_object_size": "16777216", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_device_size": "53687091200", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_capacity": "16", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_main_device_type": "SSD", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-21T13:58:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_segment_size": "67108864", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "set_keepcaps": "false", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "setgroup": "", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "setuser": "", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "setuser_match_path": "", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "thp": "false", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "threadpool_default_timeout": "60", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "throttler_perf_counter": "true" 2024-09-21T13:58:19.813 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:19.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-21T13:58:19.957 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a: {} 2024-09-21T13:58:19.958 INFO:teuthology.orchestra.run.smithi079.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T13:58:19.972 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b: {} 2024-09-21T13:58:19.972 INFO:teuthology.orchestra.run.smithi079.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T13:58:19.981 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c: {} 2024-09-21T13:58:19.981 INFO:teuthology.orchestra.run.smithi079.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T13:58:19.996 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-21T13:58:20.002 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T13:58:20.002 DEBUG:teuthology.orchestra.run.smithi079:> type ceph-objectstore-tool 2024-09-21T13:58:20.007 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T13:58:20.007 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-21T13:58:20.020 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-21T13:58:20.020 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-21T13:58:20.020 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:20.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:20.020 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T13:58:20.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T13:58:20.021 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-21T13:58:20.021 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-21T13:58:20.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:20.022 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-21T13:58:20.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:20.022 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-21T13:58:20.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:58:20.023 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-21T13:58:20.051 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:20.051+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:20.069 INFO:teuthology.orchestra.run.smithi079.stdout:mapped writes DISABLED 2024-09-21T13:58:20.069 INFO:teuthology.orchestra.run.smithi079.stdout:mapped reads DISABLED 2024-09-21T13:58:20.069 INFO:teuthology.orchestra.run.smithi079.stdout:Seed set to 4922 2024-09-21T13:58:20.123 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:20.120+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:20.185 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:20.185 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:20.203 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:20.203 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:20.215 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:20.215 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:20.224 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:20.220+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:20.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:20.233 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:20.234 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:20.251 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:20.251 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:20.271 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:20.271 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:20.304 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:20.305 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:20.324 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:20.320+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:20.327 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:20.327 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:20.339 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:20.339 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:20.347 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:20.352 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 22, 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-21T13:57:52.430765+0000", 2024-09-21T13:58:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-21T13:58:17.139590+0000", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-21T13:58:03.658559+0000", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-21T13:57:54.820932+0000", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T13:58:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 2, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "reef", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:05.200492+0000", 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T13:58:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-21T13:58:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "17", 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:58:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:58:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:58:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-21T13:58:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:10.681325+0000", 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T13:58:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-21T13:58:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "21", 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:58:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 21, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:58:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:58:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:58:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:58:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:58:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:58:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:58:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:58:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:58:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:58:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:58:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T13:58:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9900000095367432, 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9900000095367432, 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-21T13:58:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "4f3cec52-e90a-4dc6-8a9d-879659a7f8b3", 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6818/3285725925", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6823/3285725925", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/3285725925", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6827/3285725925", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "f30fdaae-2baf-49e5-b8c2-24477eabf5c6", 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.409 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 18, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-21T13:58:20.410 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.411 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-21T13:58:20.414 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6819/1533952849", 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6822/1533952849", 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6830/1533952849", 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6826/1533952849", 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "54acbaba-89a5-4b6c-bd93-89e0683f2125", 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 18, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.416 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.417 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.418 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.419 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.420 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/3403916996", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/3403916996", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/3403916996", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/3403916996", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "76fc66bf-6186-4666-b92f-c8093d20d625", 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.421 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-21T13:58:20.422 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.423 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:58:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/3937234571", 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/3937234571", 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/3937234571", 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/3937234571", 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:58:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c90b7f74-168e-4c89-b1cf-c9ce463afa6e", 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6824", 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6825", 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6826", 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6827", 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6830", 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6831", 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6828", 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6829", 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6825/3468135680", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6827/3468135680", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3468135680", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3468135680", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "b837d993-44f1-4dd3-99f7-675e6abcd9c7", 2024-09-21T13:58:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 18, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6816", 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6817", 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6818", 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6819", 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6822", 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6823", 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6820", 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6821", 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6817/3245816486", 2024-09-21T13:58:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6819/3245816486", 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6823/3245816486", 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6821/3245816486", 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c68ceefc-f355-4f66-870e-95ce4a9bc37e", 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 18, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6808", 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6809", 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6810", 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6811", 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6814", 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6815", 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6812", 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6813", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6809/2399307560", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6811/2399307560", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2399307560", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2399307560", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "e1909a46-859c-45e8-b84b-0e11db556c48", 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 18, 2024-09-21T13:58:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6800", 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6801", 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6802", 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6803", 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6806", 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6807", 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6804", 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6805", 2024-09-21T13:58:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6801/2163234632", 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6803/2163234632", 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2163234632", 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2163234632", 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.368141+0000", 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343412+0000", 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343898+0000", 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.285851+0000", 2024-09-21T13:58:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.330406+0000", 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:58:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.151465+0000", 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.197502+0000", 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.171570+0000", 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-21T13:58:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [ 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 2, 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:20.459 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:20.462 INFO:tasks.thrashosds.thrasher:j is {'epoch': 22, 'fsid': 'af11199c-39d9-4003-9df0-1f9fd66ab792', 'created': '2024-09-21T13:57:52.430765+0000', 'modified': '2024-09-21T13:58:17.139590+0000', 'last_up_change': '2024-09-21T13:58:03.658559+0000', 'last_in_change': '2024-09-21T13:57:54.820932+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:58:05.200492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T13:58:10.681325+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6818', 'nonce': 3285725925}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 3285725925}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6829', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 3285725925}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6825', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 3285725925}]}, 'public_addr': '172.21.15.79:6818/3285725925', 'cluster_addr': '172.21.15.79:6823/3285725925', 'heartbeat_back_addr': '172.21.15.79:6831/3285725925', 'heartbeat_front_addr': '172.21.15.79:6827/3285725925', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6817', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1533952849}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6821', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6822', 'nonce': 1533952849}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6830', 'nonce': 1533952849}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6826', 'nonce': 1533952849}]}, 'public_addr': '172.21.15.79:6819/1533952849', 'cluster_addr': '172.21.15.79:6822/1533952849', 'heartbeat_back_addr': '172.21.15.79:6830/1533952849', 'heartbeat_front_addr': '172.21.15.79:6826/1533952849', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '54acbaba-89a5-4b6c-bd93-89e0683f2125', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 3403916996}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 3403916996}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 3403916996}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 3403916996}]}, 'public_addr': '172.21.15.79:6801/3403916996', 'cluster_addr': '172.21.15.79:6803/3403916996', 'heartbeat_back_addr': '172.21.15.79:6807/3403916996', 'heartbeat_front_addr': '172.21.15.79:6805/3403916996', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76fc66bf-6186-4666-b92f-c8093d20d625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 3937234571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 3937234571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 3937234571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 3937234571}]}, 'public_addr': '172.21.15.79:6809/3937234571', 'cluster_addr': '172.21.15.79:6811/3937234571', 'heartbeat_back_addr': '172.21.15.79:6815/3937234571', 'heartbeat_front_addr': '172.21.15.79:6813/3937234571', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3468135680}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3468135680}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3468135680}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3468135680}]}, 'public_addr': '172.21.15.134:6825/3468135680', 'cluster_addr': '172.21.15.134:6827/3468135680', 'heartbeat_back_addr': '172.21.15.134:6831/3468135680', 'heartbeat_front_addr': '172.21.15.134:6829/3468135680', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 3245816486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 3245816486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 3245816486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 3245816486}]}, 'public_addr': '172.21.15.134:6817/3245816486', 'cluster_addr': '172.21.15.134:6819/3245816486', 'heartbeat_back_addr': '172.21.15.134:6823/3245816486', 'heartbeat_front_addr': '172.21.15.134:6821/3245816486', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2399307560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2399307560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2399307560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2399307560}]}, 'public_addr': '172.21.15.134:6809/2399307560', 'cluster_addr': '172.21.15.134:6811/2399307560', 'heartbeat_back_addr': '172.21.15.134:6815/2399307560', 'heartbeat_front_addr': '172.21.15.134:6813/2399307560', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e1909a46-859c-45e8-b84b-0e11db556c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2163234632}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2163234632}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2163234632}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2163234632}]}, 'public_addr': '172.21.15.134:6801/2163234632', 'cluster_addr': '172.21.15.134:6803/2163234632', 'heartbeat_back_addr': '172.21.15.134:6807/2163234632', 'heartbeat_front_addr': '172.21.15.134:6805/2163234632', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.368141+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343412+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343898+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.285851+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.330406+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.151465+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.197502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.171570+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T13:58:20.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:58:20.462 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:20.459+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:20.489 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:20.490 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:20.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:20.562 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:20.564+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:20.635 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:58:20.663 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:20.663+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:20.671 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:20.671 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:20.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:58:20.776 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:58:20.777 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:20.775+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:20.791 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-21T13:58:20.635441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219120,"kb_used_data":2960,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755600,"statfs":{"total":773094113280,"available":772869734400,"internally_reserved":0,"allocated":3031040,"data_stored":1812750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.515714"},"pg_stats":[{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.145858+0000","last_change":"2024-09-21T13:58:14.119109+0000","last_active":"2024-09-21T13:58:17.145858+0000","last_peered":"2024-09-21T13:58:17.145858+0000","last_clean":"2024-09-21T13:58:17.145858+0000","last_became_active":"2024-09-21T13:58:11.960695+0000","last_became_peered":"2024-09-21T13:58:11.960695+0000","last_unstale":"2024-09-21T13:58:17.145858+0000","last_undegraded":"2024-09-21T13:58:17.145858+0000","last_fullsized":"2024-09-21T13:58:17.145858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:37.258572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.146193+0000","last_change":"2024-09-21T13:58:13.965360+0000","last_active":"2024-09-21T13:58:17.146193+0000","last_peered":"2024-09-21T13:58:17.146193+0000","last_clean":"2024-09-21T13:58:17.146193+0000","last_became_active":"2024-09-21T13:58:11.955322+0000","last_became_peered":"2024-09-21T13:58:11.955322+0000","last_unstale":"2024-09-21T13:58:17.146193+0000","last_undegraded":"2024-09-21T13:58:17.146193+0000","last_fullsized":"2024-09-21T13:58:17.146193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:38:29.040695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071457400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.240621+0000","last_change":"2024-09-21T13:58:14.261122+0000","last_active":"2024-09-21T13:58:17.240621+0000","last_peered":"2024-09-21T13:58:17.240621+0000","last_clean":"2024-09-21T13:58:17.240621+0000","last_became_active":"2024-09-21T13:58:12.178049+0000","last_became_peered":"2024-09-21T13:58:12.178049+0000","last_unstale":"2024-09-21T13:58:17.240621+0000","last_undegraded":"2024-09-21T13:58:17.240621+0000","last_fullsized":"2024-09-21T13:58:17.240621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:52:56.580072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080842000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.146265+0000","last_change":"2024-09-21T13:58:13.965696+0000","last_active":"2024-09-21T13:58:17.146265+0000","last_peered":"2024-09-21T13:58:17.146265+0000","last_clean":"2024-09-21T13:58:17.146265+0000","last_became_active":"2024-09-21T13:58:12.177138+0000","last_became_peered":"2024-09-21T13:58:12.177138+0000","last_unstale":"2024-09-21T13:58:17.146265+0000","last_undegraded":"2024-09-21T13:58:17.146265+0000","last_fullsized":"2024-09-21T13:58:17.146265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.103500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075207099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:18.075562+0000","last_change":"2024-09-21T13:58:13.973999+0000","last_active":"2024-09-21T13:58:18.075562+0000","last_peered":"2024-09-21T13:58:18.075562+0000","last_clean":"2024-09-21T13:58:18.075562+0000","last_became_active":"2024-09-21T13:58:11.956462+0000","last_became_peered":"2024-09-21T13:58:11.956462+0000","last_unstale":"2024-09-21T13:58:18.075562+0000","last_undegraded":"2024-09-21T13:58:18.075562+0000","last_fullsized":"2024-09-21T13:58:18.075562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:20:15.859666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.147226+0000","last_change":"2024-09-21T13:58:13.972457+0000","last_active":"2024-09-21T13:58:17.147226+0000","last_peered":"2024-09-21T13:58:17.147226+0000","last_clean":"2024-09-21T13:58:17.147226+0000","last_became_active":"2024-09-21T13:58:11.950788+0000","last_became_peered":"2024-09-21T13:58:11.950788+0000","last_unstale":"2024-09-21T13:58:17.147226+0000","last_undegraded":"2024-09-21T13:58:17.147226+0000","last_fullsized":"2024-09-21T13:58:17.147226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:46:21.420761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054402300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:17.240567+0000","last_change":"2024-09-21T13:58:14.261067+0000","last_active":"2024-09-21T13:58:17.240567+0000","last_peered":"2024-09-21T13:58:17.240567+0000","last_clean":"2024-09-21T13:58:17.240567+0000","last_became_active":"2024-09-21T13:58:11.955637+0000","last_became_peered":"2024-09-21T13:58:11.955637+0000","last_unstale":"2024-09-21T13:58:17.240567+0000","last_undegraded":"2024-09-21T13:58:17.240567+0000","last_fullsized":"2024-09-21T13:58:17.240567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:37.122435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-21T13:58:18.075485+0000","last_change":"2024-09-21T13:58:13.972806+0000","last_active":"2024-09-21T13:58:18.075485+0000","last_peered":"2024-09-21T13:58:18.075485+0000","last_clean":"2024-09-21T13:58:18.075485+0000","last_became_active":"2024-09-21T13:58:11.955126+0000","last_became_peered":"2024-09-21T13:58:11.955126+0000","last_unstale":"2024-09-21T13:58:18.075485+0000","last_undegraded":"2024-09-21T13:58:18.075485+0000","last_fullsized":"2024-09-21T13:58:18.075485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:54:29.039520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-21T13:58:14.260180+0000","last_change":"2024-09-21T13:58:06.893092+0000","last_active":"2024-09-21T13:58:14.260180+0000","last_peered":"2024-09-21T13:58:14.260180+0000","last_clean":"2024-09-21T13:58:14.260180+0000","last_became_active":"2024-09-21T13:58:06.892337+0000","last_became_peered":"2024-09-21T13:58:06.892337+0000","last_unstale":"2024-09-21T13:58:14.260180+0000","last_undegraded":"2024-09-21T13:58:14.260180+0000","last_fullsized":"2024-09-21T13:58:14.260180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:39:24.144363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-21T13:58:20.631560+0000","last_change":"2024-09-21T13:58:20.631560+0000","last_active":"2024-09-21T13:58:20.631560+0000","last_peered":"2024-09-21T13:58:20.631560+0000","last_clean":"2024-09-21T13:58:20.631560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-21T13:58:20.631560+0000","last_undegraded":"2024-09-21T13:58:20.631560+0000","last_fullsized":"2024-09-21T13:58:20.631560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":669365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":78997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":78997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1140000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":78997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":78997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":79016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":669365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:58:20.794 INFO:tasks.thrashosds.thrasher:No pools; doing nothing 2024-09-21T13:58:20.834 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:20.834 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:20.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:20.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:20.891+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:20.966 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:20.967+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:21.003 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.003 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:21.067 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:21.064+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:21.168 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:21.164+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:21.177 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.177 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:21.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:21.267+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:21.306 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.306 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:21.410 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:21.411+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:21.471 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:21.468+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:21.478 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.479 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:21.572 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:21.572+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:21.669 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.669 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.672 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:21.671+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:21.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:21.774 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:21.771+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:21.845 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:21.845 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:21.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:21.875 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:21.872+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:21.975 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:21.975+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:22.026 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:22.026 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:22.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:22.082 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:22.083+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:22.172 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:22.172 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:22.178 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:22.176+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:22.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:22.278 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:22.276+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:22.350 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:22.350 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:22.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:22.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:22.410 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:22.411+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:22.480 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:22.476+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:22.517 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:22.518 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:22.526 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:22.527 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:22.534 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:22.534 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:22.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:22.549 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:22.550 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:22.566 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:22.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:22.579+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:22.586 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:22.586 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:22.603 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:22.603 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:22.620 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:22.637 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:22.637 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:22.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:58:22.699 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:22.699+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:22.706 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:22.706 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:22.706 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:22.706 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:22.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:22.783 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:22.783+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:22.841 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:22.841 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:22.841 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:22.841 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:22.841 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:22.856 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:22.901 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:22.900+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:22.980 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4248.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:11.952490+0000", 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.028789372, 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070842750000000001, 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4248", 2024-09-21T13:58:22.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/601082488", 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952490+0000", 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952490+0000", 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952483+0000", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999928 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952504+0000", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1512999999999999e-05 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952534+0000", 2024-09-21T13:58:22.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0086999999999998e-05 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.952558+0000", 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3195999999999999e-05 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.953030+0000", 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047226599999999999 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:58:22.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.953051+0000", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000001e-05 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.955907+0000", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028557819999999999 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.956290+0000", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000382963 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:22.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.956813+0000", 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00052344000000000002 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958772+0000", 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001958614 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.959371+0000", 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059951899999999996 2024-09-21T13:58:22.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.959497+0000", 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125692 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.959575+0000", 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7383000000000001e-05 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4248.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:11.958540+0000", 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.022739559, 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000238805, 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958540+0000", 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958540+0000", 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958538+0000", 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:22.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958555+0000", 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6736999999999999e-05 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958594+0000", 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9212999999999999e-05 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958618+0000", 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4417e-05 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958740+0000", 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121296 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:22.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958763+0000", 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3189000000000001e-05 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.958779+0000", 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6007000000000001e-05 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4248.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:11.962958+0000", 2024-09-21T13:58:22.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.01832119, 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000385607, 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4248", 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/601082488", 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:22.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.962958+0000", 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.962958+0000", 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.962956+0000", 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.962975+0000", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9556999999999999e-05 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963006+0000", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0911999999999998e-05 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963022+0000", 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5823000000000001e-05 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963136+0000", 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011369 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963344+0000", 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020837500000000001 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:22.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4248.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:11.963734+0000", 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.017545856, 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032647699999999998, 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4248", 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/601082488", 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963734+0000", 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963734+0000", 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963732+0000", 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963742+0000", 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6460000000000005e-06 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963763+0000", 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.128e-05 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963775+0000", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1613e-05 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.963860+0000", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5445999999999995e-05 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:11.964060+0000", 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020004500000000001 2024-09-21T13:58:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4248.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:12.952863+0000", 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.028416798, 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042256139999999999, 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4248", 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/601082488", 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 5 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952863+0000", 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952863+0000", 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952860+0000", 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952879+0000", 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8700000000000001e-05 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952915+0000", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6468999999999999e-05 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.952950+0000", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4709999999999998e-05 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.953119+0000", 2024-09-21T13:58:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016950600000000001 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.953511+0000", 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039206700000000001 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.953873+0000", 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036125300000000002 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.955761+0000", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001888439 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956868+0000", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011073350000000001 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956996+0000", 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012796199999999999 2024-09-21T13:58:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.957088+0000", 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2165999999999998e-05 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4248.0:5 2.2 e20/18 ondisk, result = 0)", 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:12.956635+0000", 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.024644223999999, 2024-09-21T13:58:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000465663, 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956635+0000", 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956635+0000", 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956633+0000", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956649+0000", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5843000000000001e-05 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956685+0000", 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6062999999999997e-05 2024-09-21T13:58:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956704+0000", 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9347e-05 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956824+0000", 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119356 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.956849+0000", 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5199999999999999e-05 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:12.957101+0000", 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025219400000000002 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4248.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:13.968271+0000", 2024-09-21T13:58:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0130090460000005, 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069137060000000004, 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4248", 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/601082488", 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968271+0000", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968271+0000", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968267+0000", 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-09-21T13:58:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968283+0000", 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6133e-05 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968320+0000", 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6213e-05 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968338+0000", 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8182999999999999e-05 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968451+0000", 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011321 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.968464+0000", 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2568999999999999e-05 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.972356+0000", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00389266 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.972511+0000", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154346 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.972748+0000", 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237424 2024-09-21T13:58:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974341+0000", 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001593442 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975045+0000", 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070384400000000002 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975127+0000", 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1662999999999994e-05 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975184+0000", 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7328999999999999e-05 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4248.0:7 2.2 e21/18 ondisk, result = 0)", 2024-09-21T13:58:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:13.974885+0000", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0063942770000001, 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031140399999999999, 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974885+0000", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974885+0000", 2024-09-21T13:58:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974879+0000", 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999933 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974894+0000", 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5282999999999999e-05 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974918+0000", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3482999999999999e-05 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.974934+0000", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6460000000000002e-05 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975023+0000", 2024-09-21T13:58:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8479000000000004e-05 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975036+0000", 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.375e-05 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:13.975197+0000", 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000160466 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.024 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.025 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:23.026 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:23.023+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:23.126 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:23.127+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:23.195 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:23.196 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:23.196 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:23.253 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:23.252+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:23.328 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.328 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:23.329 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:23.329 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:23.329 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.329 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:23.327+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:23.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:23.430 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:23.427+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:23.506 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:23.507 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [] 2024-09-21T13:58:23.507 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.520 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:23.530 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:23.531+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:23.631 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:23.628+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:23.637 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.638 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:23.638 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:23.638 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:23.656 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:58:23.732 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:23.731+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:23.812 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.812 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:23.812 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:23.812 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:23.812 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:23.826 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:23.833 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:23.831+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:23.934 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:23.932+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.951 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.72934514, 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011514554, 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 107 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219216+0000", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219223+0000", 2024-09-21T13:58:23.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5429999999999999e-06 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219233+0000", 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219240+0000", 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6229999999999997e-06 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223392+0000", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041511999999999999 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223612+0000", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022086999999999999 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223941+0000", 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032844299999999999 2024-09-21T13:58:23.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226699+0000", 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027585000000000001 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230510+0000", 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038104269999999999 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230626+0000", 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115952 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230732+0000", 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106136 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728898569999998, 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012741621999999999, 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 108 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:23.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219662+0000", 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219673+0000", 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-05 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219692+0000", 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8712999999999999e-05 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219705+0000", 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3599e-05 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225447+0000", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005741833 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225577+0000", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130376 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225789+0000", 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021166199999999999 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229333+0000", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035441320000000002 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232267+0000", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029338179999999999 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232348+0000", 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1382000000000001e-05 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232405+0000", 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7166999999999997e-05 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728811403999998, 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012774071, 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.963 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 109 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219750+0000", 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219907+0000", 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156403 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219921+0000", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.482e-05 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219931+0000", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4360000000000008e-06 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226781+0000", 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068506069999999999 2024-09-21T13:58:23.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226919+0000", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137429 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.227152+0000", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233162 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232127+0000", 2024-09-21T13:58:23.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049746449999999998 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232424+0000", 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000297034 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232482+0000", 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8122999999999999e-05 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232525+0000", 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3235999999999997e-05 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728620118999999, 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012742565000000001, 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:23.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219948+0000", 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1229999999999997e-06 2024-09-21T13:58:23.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219957+0000", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7629999999999995e-06 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219965+0000", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.396e-06 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228375+0000", 2024-09-21T13:58:23.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084096299999999995 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228500+0000", 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125439 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228691+0000", 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019109800000000001 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232251+0000", 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035597889999999998 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232567+0000", 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031582399999999998 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232626+0000", 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9777e-05 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232685+0000", 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8458999999999997e-05 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728589230000001, 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013935693000000001, 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 111 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:23.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219978+0000", 2024-09-21T13:58:23.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5459999999999999e-06 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219993+0000", 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5347000000000001e-05 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220005+0000", 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1742999999999999e-05 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229422+0000", 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094169749999999993 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229559+0000", 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013675199999999999 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229808+0000", 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024875800000000002 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232834+0000", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030260259999999998 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233795+0000", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096086000000000001 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233858+0000", 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3195999999999996e-05 2024-09-21T13:58:23.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233909+0000", 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1136e-05 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728509316, 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014946408, 2024-09-21T13:58:23.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 112 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220052+0000", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220244+0000", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019178199999999999 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220267+0000", 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3200000000000001e-05 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220284+0000", 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7269999999999999e-05 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230829+0000", 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010545362000000001 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230982+0000", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015277199999999999 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.231238+0000", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025577400000000001 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233998+0000", 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027597860000000002 2024-09-21T13:58:23.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234878+0000", 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088049999999999999 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234945+0000", 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6863e-05 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235000+0000", 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4353e-05 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728258045, 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017429495999999999, 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220303+0000", 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220314+0000", 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0713000000000001e-05 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220335+0000", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1022999999999998e-05 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220351+0000", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6243e-05 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232917+0000", 2024-09-21T13:58:23.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012565679999999999 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233050+0000", 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013379599999999999 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233241+0000", 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190745 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237560+0000", 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043189669999999999 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237579+0000", 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8963000000000001e-05 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237664+0000", 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5255999999999998e-05 2024-09-21T13:58:23.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237734+0000", 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9480000000000006e-05 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:23.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728194746, 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017968921999999998, 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 114 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220367+0000", 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:23.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220399+0000", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999997e-05 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220418+0000", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8595999999999999e-05 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220433+0000", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5227e-05 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:23.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234073+0000", 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013639642 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234189+0000", 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116482 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234366+0000", 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017661900000000001 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237899+0000", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035332760000000001 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238094+0000", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019485800000000001 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238227+0000", 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133196 2024-09-21T13:58:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238337+0000", 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109249 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.728102765999999, 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018118983000000002, 2024-09-21T13:58:23.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 115 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220458+0000", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220640+0000", 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018189500000000001 2024-09-21T13:58:24.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220657+0000", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6385999999999999e-05 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220667+0000", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9839999999999996e-06 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235066+0000", 2024-09-21T13:58:24.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014399646 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235198+0000", 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013142199999999999 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235474+0000", 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027618800000000002 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238069+0000", 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025946929999999999 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238356+0000", 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028751800000000001 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238487+0000", 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013092900000000001 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238579+0000", 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1651999999999996e-05 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.727882885, 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019065693000000002, 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 116 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:24.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220679+0000", 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220685+0000", 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5130000000000002e-06 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220695+0000", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0087e-05 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220703+0000", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236459+0000", 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015756791999999999 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236637+0000", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017799800000000001 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236824+0000", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018612899999999999 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239484+0000", 2024-09-21T13:58:24.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026603590000000002 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239505+0000", 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1250000000000002e-05 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239639+0000", 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013371600000000001 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239745+0000", 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010642200000000001 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.727851121, 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019735127000000002, 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 117 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220730+0000", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9113000000000001e-05 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220741+0000", 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1076e-05 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220749+0000", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6499999999999996e-06 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238669+0000", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017920609000000001 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238805+0000", 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013605900000000001 2024-09-21T13:58:24.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239009+0000", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020428199999999999 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240104+0000", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010946669999999999 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240316+0000", 2024-09-21T13:58:24.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000211416 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240390+0000", 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4308999999999996e-05 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240446+0000", 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6606e-05 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228990698, 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011537083, 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 135 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719570+0000", 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719590+0000", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9083e-05 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719616+0000", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.618e-05 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719657+0000", 2024-09-21T13:58:24.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1452999999999998e-05 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722519+0000", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002861653 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722607+0000", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8500999999999999e-05 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722744+0000", 2024-09-21T13:58:24.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137136 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724971+0000", 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022261360000000001 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731059+0000", 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060883100000000004 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731087+0000", 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8371e-05 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731109+0000", 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.156e-05 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228882265999999, 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011491291000000001, 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719679+0000", 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719690+0000", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1212999999999999e-05 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719716+0000", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5837e-05 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719733+0000", 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7499999999999998e-05 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723127+0000", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033932630000000001 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723182+0000", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5408999999999998e-05 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723278+0000", 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5713999999999999e-05 2024-09-21T13:58:24.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726316+0000", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003038266 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731132+0000", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004815639 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731154+0000", 2024-09-21T13:58:24.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2734e-05 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731171+0000", 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7099e-05 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228806898999999, 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013736454, 2024-09-21T13:58:24.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 137 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719754+0000", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719883+0000", 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012819200000000001 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719900+0000", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719924+0000", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4142999999999999e-05 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723694+0000", 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037706620000000001 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723785+0000", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0116000000000003e-05 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723864+0000", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9505999999999994e-05 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728675+0000", 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048111040000000001 2024-09-21T13:58:24.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733449+0000", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047735390000000003 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733473+0000", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3747000000000002e-05 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733492+0000", 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9494999999999999e-05 2024-09-21T13:58:24.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228625804, 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013630234999999999, 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719936+0000", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719942+0000", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5030000000000002e-06 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719970+0000", 2024-09-21T13:58:24.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7603999999999999e-05 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719978+0000", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2959999999999999e-06 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724443+0000", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044649080000000001 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724562+0000", 2024-09-21T13:58:24.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118934 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724681+0000", 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011854900000000001 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728718+0000", 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037461 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733525+0000", 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048072929999999998 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733549+0000", 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3524999999999999e-05 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733567+0000", 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969e-05 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228575154000001, 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013651037, 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719992+0000", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000001e-06 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720003+0000", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1026000000000001e-05 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720011+0000", 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-09-21T13:58:24.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725002+0000", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049909619999999998 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725050+0000", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8528e-05 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725128+0000", 2024-09-21T13:58:24.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7478000000000006e-05 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728748+0000", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036200719999999998 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733599+0000", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048515759999999998 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733621+0000", 2024-09-21T13:58:24.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1515e-05 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733638+0000", 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7606000000000001e-05 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:24.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228543881, 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013681027, 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 140 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720018+0000", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720109+0000", 2024-09-21T13:58:24.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720122+0000", 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2523e-05 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720130+0000", 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2770000000000005e-06 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725655+0000", 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055245240000000003 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725703+0000", 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8680000000000001e-05 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725815+0000", 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011137399999999999 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731304+0000", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054890980000000004 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733661+0000", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002356763 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733683+0000", 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2052000000000002e-05 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733700+0000", 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6986999999999998e-05 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.228421462, 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013987249, 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 141 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720140+0000", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720146+0000", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9499999999999998e-06 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720156+0000", 2024-09-21T13:58:24.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9229999999999997e-06 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720166+0000", 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0146000000000001e-05 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726335+0000", 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061690859999999998 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726379+0000", 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3435e-05 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726449+0000", 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9788000000000003e-05 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731322+0000", 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048735330000000002 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734089+0000", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002766653 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734111+0000", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2183000000000001e-05 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734128+0000", 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7314999999999999e-05 2024-09-21T13:58:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.511304628, 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01296108, 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437257+0000", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437409+0000", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015206900000000001 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437430+0000", 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1107e-05 2024-09-21T13:58:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437441+0000", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0397000000000001e-05 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443090+0000", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056497759999999996 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443259+0000", 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016870500000000001 2024-09-21T13:58:24.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443448+0000", 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018835499999999999 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.445870+0000", 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024222219999999999 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450086+0000", 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042161070000000002 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450157+0000", 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1277000000000002e-05 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450219+0000", 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1742000000000006e-05 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.511103443, 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01305037, 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 159 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:24.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437458+0000", 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437465+0000", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5200000000000003e-06 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437475+0000", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.023e-05 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437482+0000", 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2060000000000001e-06 2024-09-21T13:58:24.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444668+0000", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071858080000000001 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444788+0000", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120252 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444983+0000", 2024-09-21T13:58:24.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000194969 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.446570+0000", 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001586861 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450332+0000", 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037621909999999998 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:24.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450447+0000", 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114972 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450509+0000", 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2197000000000001e-05 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:24.068 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:24.070 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:24.068+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:24.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:24.171 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:24.168+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:24.186 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:24.186 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:24.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:24.272 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:24.268+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:24.314 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:24.314 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:24.314 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:24.314 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:24.314 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:24.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:24.373 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:24.371+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:24.442 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:24.442 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.477438722999999, 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051845399999999996, 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:24.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964058+0000", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964141+0000", 2024-09-21T13:58:24.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3331999999999994e-05 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964162+0000", 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1056999999999998e-05 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964190+0000", 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8243e-05 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964261+0000", 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0458999999999997e-05 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964293+0000", 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2270000000000001e-05 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969166+0000", 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048727919999999999 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969243+0000", 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7516999999999997e-05 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.475169963999999, 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050517169999999998, 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966326+0000", 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966337+0000", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0256e-05 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966358+0000", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1063000000000001e-05 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966370+0000", 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2724e-05 2024-09-21T13:58:24.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966469+0000", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8921999999999999e-05 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966508+0000", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.888e-05 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971275+0000", 2024-09-21T13:58:24.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047667059999999999 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971379+0000", 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104286 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.415101772, 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053209900000000003, 2024-09-21T13:58:24.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026394+0000", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026419+0000", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5256e-05 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026443+0000", 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3842999999999999e-05 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026455+0000", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2207e-05 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027293+0000", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00083795300000000001 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027352+0000", 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.91e-05 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031648+0000", 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042961600000000003 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031717+0000", 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8167e-05 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:129 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'87, mlcod=16'85)", 2024-09-21T13:58:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.722111330000001, 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049320420000000002, 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:24.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719384+0000", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719398+0000", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3283e-05 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719427+0000", 2024-09-21T13:58:24.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000001e-05 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719445+0000", 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8034e-05 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719536+0000", 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1428999999999995e-05 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719574+0000", 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999997e-05 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724235+0000", 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004660717 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724318+0000", 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3228999999999999e-05 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:132 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'90, mlcod=16'85)", 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.720585988, 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056392600000000001, 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720910+0000", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720925+0000", 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4773000000000001e-05 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720947+0000", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1953000000000001e-05 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720961+0000", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4446e-05 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722303+0000", 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013414729999999999 2024-09-21T13:58:24.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722362+0000", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726455+0000", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040928379999999997 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726551+0000", 2024-09-21T13:58:24.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5649999999999994e-05 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:133 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'91, mlcod=16'85)", 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.719970412999999, 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075400450000000004, 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721526+0000", 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721538+0000", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-05 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721567+0000", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9635999999999999e-05 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721582+0000", 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.486e-05 2024-09-21T13:58:24.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723342+0000", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017600960000000001 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723402+0000", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9688999999999997e-05 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.728990+0000", 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055877940000000001 2024-09-21T13:58:24.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729067+0000", 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7236000000000004e-05 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'85)", 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.719446266999999, 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070881590000000001, 2024-09-21T13:58:24.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722050+0000", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722126+0000", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5774999999999999e-05 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722177+0000", 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1583999999999999e-05 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722196+0000", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8972999999999999e-05 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724546+0000", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002350071 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724582+0000", 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5553000000000003e-05 2024-09-21T13:58:24.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729077+0000", 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044949250000000003 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729139+0000", 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2473999999999999e-05 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'85)", 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.718651138999999, 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079821179999999999, 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722844+0000", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722858+0000", 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3606e-05 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722886+0000", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8116e-05 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722899+0000", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2802999999999999e-05 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725603+0000", 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704166 2024-09-21T13:58:24.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725660+0000", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6709999999999997e-05 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730755+0000", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050949139999999999 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730828+0000", 2024-09-21T13:58:24.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3592999999999998e-05 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:136 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'85)", 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.718135727, 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075270889999999998, 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723361+0000", 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723371+0000", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0209e-05 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723387+0000", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.579e-05 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723400+0000", 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3113e-05 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726660+0000", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003260092 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726721+0000", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1116000000000002e-05 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730837+0000", 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041155280000000002 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730889+0000", 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2227e-05 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'85)", 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.717503608000001, 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092100250000000002, 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.481 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723993+0000", 2024-09-21T13:58:24.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724109+0000", 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115919 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724128+0000", 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9497e-05 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724142+0000", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3596e-05 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727440+0000", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003298685 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727493+0000", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2973000000000003e-05 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733130+0000", 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056365670000000003 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733204+0000", 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3812000000000004e-05 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:138 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'85)", 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:24.485 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.716760201, 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085262879999999999, 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724736+0000", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724744+0000", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0929999999999997e-06 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724763+0000", 2024-09-21T13:58:24.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000001e-05 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724848+0000", 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4746000000000005e-05 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729217+0000", 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043694019999999997 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729253+0000", 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6096999999999997e-05 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733208+0000", 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003954323 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733263+0000", 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5779999999999998e-05 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'85)", 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.716311020999999, 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081432770000000008, 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725195+0000", 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0899999999999994e-06 2024-09-21T13:58:24.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725211+0000", 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6863000000000001e-05 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725221+0000", 2024-09-21T13:58:24.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0170000000000002e-06 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729879+0000", 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046583570000000001 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729934+0000", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5276999999999999e-05 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733270+0000", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033358509999999999 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733330+0000", 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9639000000000003e-05 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'88)", 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.715493118000001, 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073847440000000004, 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726002+0000", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726122+0000", 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119323 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726208+0000", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6458999999999993e-05 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726227+0000", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8666999999999999e-05 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730976+0000", 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004749573 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.731011+0000", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5126999999999998e-05 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733333+0000", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023211389999999998 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733389+0000", 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6465999999999998e-05 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'88)", 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.714974672, 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073917740000000003, 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726521+0000", 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726535+0000", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3543000000000001e-05 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726557+0000", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2160000000000001e-05 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726570+0000", 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.287e-05 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732292+0000", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057226129999999997 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732349+0000", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6375999999999997e-05 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733845+0000", 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014963680000000001 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733914+0000", 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9419999999999996e-05 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:155 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'109, mlcod=16'105)", 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.439562+0000", 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.001935651, 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046852899999999999, 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439562+0000", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439562+0000", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439561+0000", 2024-09-21T13:58:24.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439752+0000", 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019114699999999999 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439765+0000", 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2666999999999999e-05 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439773+0000", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0539999999999995e-06 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439810+0000", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6980000000000002e-05 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.439827+0000", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6937000000000001e-05 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.444172+0000", 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043454260000000003 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.444247+0000", 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4782000000000003e-05 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:156 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'110, mlcod=16'105)", 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.000545381999999, 2024-09-21T13:58:24.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061283630000000004, 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440951+0000", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440957+0000", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2939999999999996e-06 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440966+0000", 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3689999999999996e-06 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440973+0000", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5339999999999996e-06 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441011+0000", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8824e-05 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441028+0000", 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6407999999999999e-05 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.446998+0000", 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059700179999999997 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447080+0000", 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2496000000000004e-05 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:157 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'111, mlcod=16'106)", 2024-09-21T13:58:24.513 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.999258147999999, 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048843990000000002, 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:24.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442244+0000", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1889999999999998e-06 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442256+0000", 2024-09-21T13:58:24.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2115e-05 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442262+0000", 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8030000000000002e-06 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442296+0000", 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3906999999999999e-05 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442311+0000", 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5313999999999999e-05 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447084+0000", 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047726640000000002 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447124+0000", 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0024000000000002e-05 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:158 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'112, mlcod=17'107)", 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.997937895, 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061998649999999997, 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443660+0000", 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101098 2024-09-21T13:58:24.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443669+0000", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9879999999999993e-06 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443674+0000", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443708+0000", 2024-09-21T13:58:24.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4474999999999998e-05 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443723+0000", 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5012e-05 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449688+0000", 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059649200000000003 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449759+0000", 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1218999999999997e-05 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:159 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'113, mlcod=17'107)", 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.996423440000001, 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047244330000000001, 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445072+0000", 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445089+0000", 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.719e-05 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445114+0000", 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.472e-05 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445126+0000", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2156e-05 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445185+0000", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8566999999999997e-05 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445215+0000", 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0593000000000003e-05 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449763+0000", 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045475580000000002 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449798+0000", 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5366e-05 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.526 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.770093256, 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052270329999999999, 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:24.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671402+0000", 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671416+0000", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4483e-05 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671442+0000", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.588e-05 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671457+0000", 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4837999999999999e-05 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671533+0000", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5984999999999998e-05 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671540+0000", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6839999999999999e-06 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674569+0000", 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003029402 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674725+0000", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015601699999999999 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674963+0000", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000237801 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676421+0000", 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001457928 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676520+0000", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9550999999999996e-05 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676590+0000", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9983999999999999e-05 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676631+0000", 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0904e-05 2024-09-21T13:58:24.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:24.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:24.533 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:24.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:24.535 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:24.536+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:24.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:24.635+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:24.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:24.698 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:24.698 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:24.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:24.755 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:24.755+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:24.791 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:24.792 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:24.807 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:24.824 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:24.837 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:24.836+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:24.840 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:24.840 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:24.860 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:24.860 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:24.866 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:24.866 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:24.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:24.880 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:24.881 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:24.901 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:24.902 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:24.920 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:24.920 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:24.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:24.979+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:24.990 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:24.990 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:25.039 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:25.036+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:25.140 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:25.139+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:25.164 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.164 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:25.241 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:25.236+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:25.334 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.334 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.342 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:25.340+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:25.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:25.443 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:25.440+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:25.468 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.468 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:25.543 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:25.540+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:25.562 INFO:teuthology.orchestra.run.smithi079.stdout:skipping zero length punch hole 2024-09-21T13:58:25.562 INFO:teuthology.orchestra.run.smithi079.stdout:skipping zero length punch hole 2024-09-21T13:58:25.562 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xdab15a3 2024-09-21T13:58:25.579 INFO:teuthology.orchestra.run.smithi079.stdout:4 trunc from 0x0 to 0xdab15a3 2024-09-21T13:58:25.593 INFO:teuthology.orchestra.run.smithi079.stdout:9 read 0x3be09bd thru 0x3be3ea7 (0x34eb bytes) 2024-09-21T13:58:25.593 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.597 INFO:teuthology.orchestra.run.smithi079.stdout:11 trunc from 0xdab15a3 to 0xa553b5b 2024-09-21T13:58:25.609 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.609 INFO:teuthology.orchestra.run.smithi079.stdout:14 writesame 0x5848250 thru 0x5856e67 data_size 0x14(0xec18 bytes) 2024-09-21T13:58:25.611 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.611 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.616 INFO:teuthology.orchestra.run.smithi079.stdout:15 read 0x944606b thru 0x94550b6 (0xf04c bytes) 2024-09-21T13:58:25.616 INFO:teuthology.orchestra.run.smithi079.stdout:16 read 0x4f24da5 thru 0x4f33401 (0xe65d bytes) 2024-09-21T13:58:25.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:25.630 INFO:teuthology.orchestra.run.smithi079.stdout:18 write 0xa9a7b3b thru 0xa9ad339 (0x57ff bytes) 2024-09-21T13:58:25.637 INFO:teuthology.orchestra.run.smithi079.stdout:21 trunc from 0xa9ad33a to 0xb691e8d 2024-09-21T13:58:25.644 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:25.643+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:22 writesame 0xd6cf7d8 thru 0xd6d7af5 data_size 0xd(0x831e bytes) 2024-09-21T13:58:25.663 INFO:teuthology.orchestra.run.smithi079.stdout:23 write 0x7c29994 thru 0x7c3365c (0x9cc9 bytes) 2024-09-21T13:58:25.669 INFO:teuthology.orchestra.run.smithi079.stdout:26 read 0x46db6ab thru 0x46e5108 (0x9a5e bytes) 2024-09-21T13:58:25.669 INFO:teuthology.orchestra.run.smithi079.stdout:28 punch from 0x90a775d to 0x90afd0c, (0x85af bytes) 2024-09-21T13:58:25.669 INFO:teuthology.orchestra.run.smithi079.stdout:29 write 0xd3087ac thru 0xd311cfd (0x9552 bytes) 2024-09-21T13:58:25.674 INFO:teuthology.orchestra.run.smithi079.stdout:33 read 0xa1d793 thru 0xa255dc (0x7e4a bytes) 2024-09-21T13:58:25.674 INFO:teuthology.orchestra.run.smithi079.stdout:34 read 0x69fbee0 thru 0x6a016da (0x57fb bytes) 2024-09-21T13:58:25.674 INFO:teuthology.orchestra.run.smithi079.stdout:35 punch from 0x1188d58 to 0x11891ad, (0x455 bytes) 2024-09-21T13:58:25.675 INFO:teuthology.orchestra.run.smithi079.stdout:36 write 0x3bcba3a thru 0x3bd09b2 (0x4f79 bytes) 2024-09-21T13:58:25.679 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:58:25.692 INFO:teuthology.orchestra.run.smithi079.stdout:39 trunc from 0xd6d7af6 to 0x6f0f29a 2024-09-21T13:58:25.709 INFO:teuthology.orchestra.run.smithi079.stdout:40 read 0x3958fe3 thru 0x3964b8a (0xbba8 bytes) 2024-09-21T13:58:25.727 INFO:teuthology.orchestra.run.smithi079.stdout:41 write 0xc95a910 thru 0xc963d2f (0x9420 bytes) 2024-09-21T13:58:25.733 INFO:teuthology.orchestra.run.smithi079.stdout:42 write 0x723449 thru 0x72c530 (0x90e8 bytes) 2024-09-21T13:58:25.737 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.737 INFO:teuthology.orchestra.run.smithi079.stdout:46 read 0x1a352f4 thru 0x1a4169b (0xc3a8 bytes) 2024-09-21T13:58:25.738 INFO:teuthology.orchestra.run.smithi079.stdout:48 writesame 0x4cd5972 thru 0x4cddd84 data_size 0x1(0x8413 bytes) 2024-09-21T13:58:25.745 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:25.743+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:25.749 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.749 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.761 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.761 INFO:teuthology.orchestra.run.smithi079.stdout:50 punch from 0x9bb4712 to 0x9bbbd25, (0x7613 bytes) 2024-09-21T13:58:25.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:25.773 INFO:teuthology.orchestra.run.smithi079.stdout:51 write 0xdfe1013 thru 0xdff0bf1 (0xfbdf bytes) 2024-09-21T13:58:25.779 INFO:teuthology.orchestra.run.smithi079.stdout:52 punch from 0x62ed8a0 to 0x62f0a3e, (0x319e bytes) 2024-09-21T13:58:25.779 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.779 INFO:teuthology.orchestra.run.smithi079.stdout:54 write 0x9af7af5 thru 0x9b036ca (0xbbd6 bytes) 2024-09-21T13:58:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:56 read 0xa951889 thru 0xa961309 (0xfa81 bytes) 2024-09-21T13:58:25.784 INFO:teuthology.orchestra.run.smithi079.stdout:57 writesame 0xca1b039 thru 0xca1d785 data_size 0x1(0x274d bytes) 2024-09-21T13:58:25.795 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:25.795 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:25.795 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-21T13:58:25.795 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T13:58:25.795 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T13:58:25.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-21T13:58:25.797 INFO:teuthology.orchestra.run.smithi079.stdout:58 read 0x23ce8c1 thru 0x23d2911 (0x4051 bytes) 2024-09-21T13:58:25.798 INFO:teuthology.orchestra.run.smithi079.stdout:59 write 0xcb2dfcb thru 0xcb31a58 (0x3a8e bytes) 2024-09-21T13:58:25.801 INFO:teuthology.orchestra.run.smithi079.stdout:60 punch from 0x557638f to 0x557ad38, (0x49a9 bytes) 2024-09-21T13:58:25.801 INFO:teuthology.orchestra.run.smithi079.stdout:61 writesame 0x8f6c323 thru 0x8f71d7c data_size 0x2d(0x5a5a bytes) 2024-09-21T13:58:25.807 INFO:teuthology.orchestra.run.smithi079.stdout:62 write 0x8c8c653 thru 0x8c8e7e3 (0x2191 bytes) 2024-09-21T13:58:25.809 INFO:teuthology.orchestra.run.smithi079.stdout:63 punch from 0x13aec40 to 0x13af0b4, (0x474 bytes) 2024-09-21T13:58:25.817 INFO:teuthology.orchestra.run.smithi079.stdout:65 write 0xe6e0590 thru 0xe6ef9ae (0xf41f bytes) 2024-09-21T13:58:25.821 INFO:teuthology.orchestra.run.smithi079.stdout:66 write 0xbcca574 thru 0xbcd3f91 (0x9a1e bytes) 2024-09-21T13:58:25.825 INFO:teuthology.orchestra.run.smithi079.stdout:67 writesame 0x909795c thru 0x909bb97 data_size 0xc(0x423c bytes) 2024-09-21T13:58:25.832 INFO:teuthology.orchestra.run.smithi079.stdout:68 read 0x103be7c thru 0x1043f07 (0x808c bytes) 2024-09-21T13:58:25.833 INFO:teuthology.orchestra.run.smithi079.stdout:69 punch from 0xcf8d8d9 to 0xcf98b6f, (0xb296 bytes) 2024-09-21T13:58:25.833 INFO:teuthology.orchestra.run.smithi079.stdout:70 writesame 0x760346c thru 0x760e1b4 data_size 0x3(0xad49 bytes) 2024-09-21T13:58:25.842 INFO:teuthology.orchestra.run.smithi079.stdout:71 write 0x15bb54e thru 0x15c59fd (0xa4b0 bytes) 2024-09-21T13:58:25.846 INFO:teuthology.orchestra.run.smithi079.stdout:72 write 0xd1d4660 thru 0xd1df28b (0xac2c bytes) 2024-09-21T13:58:25.847 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:25.844+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:25.850 INFO:teuthology.orchestra.run.smithi079.stdout:76 read 0x6a600fe thru 0x6a67a86 (0x7989 bytes) 2024-09-21T13:58:25.850 INFO:teuthology.orchestra.run.smithi079.stdout:77 read 0x43f2da7 thru 0x43f9d1f (0x6f79 bytes) 2024-09-21T13:58:25.857 INFO:teuthology.orchestra.run.smithi079.stdout:78 writesame 0xe827ff8 thru 0xe83419a data_size 0x1(0xc1a3 bytes) 2024-09-21T13:58:25.857 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.857 INFO:teuthology.orchestra.run.smithi079.stdout:80 write 0x433f44 thru 0x439b05 (0x5bc2 bytes) 2024-09-21T13:58:25.858 INFO:teuthology.orchestra.run.smithi079.stdout:81 read 0xe7ec6c3 thru 0xe7f82ef (0xbc2d bytes) 2024-09-21T13:58:25.858 INFO:teuthology.orchestra.run.smithi079.stdout:82 write 0x3b5fa76 thru 0x3b64b32 (0x50bd bytes) 2024-09-21T13:58:25.860 INFO:teuthology.orchestra.run.smithi079.stdout:83 read 0x309875d thru 0x30a2253 (0x9af7 bytes) 2024-09-21T13:58:25.860 INFO:teuthology.orchestra.run.smithi079.stdout:84 write 0x1f5ae97 thru 0x1f689f7 (0xdb61 bytes) 2024-09-21T13:58:25.863 INFO:teuthology.orchestra.run.smithi079.stdout:85 write 0x4aaffbf thru 0x4ab74a6 (0x74e8 bytes) 2024-09-21T13:58:25.867 INFO:teuthology.orchestra.run.smithi079.stdout:86 write 0xc181cb7 thru 0xc18f2be (0xd608 bytes) 2024-09-21T13:58:25.871 INFO:teuthology.orchestra.run.smithi079.stdout:88 punch from 0xa851291 to 0xa852a7e, (0x17ed bytes) 2024-09-21T13:58:25.871 INFO:teuthology.orchestra.run.smithi079.stdout:89 read 0x45def3e thru 0x45eba59 (0xcb1c bytes) 2024-09-21T13:58:25.871 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.871 INFO:teuthology.orchestra.run.smithi079.stdout:92 read 0x153c52c thru 0x153e70e (0x21e3 bytes) 2024-09-21T13:58:25.871 INFO:teuthology.orchestra.run.smithi079.stdout:93 write 0x1eb8fd6 thru 0x1ec7b66 (0xeb91 bytes) 2024-09-21T13:58:25.873 INFO:teuthology.orchestra.run.smithi079.stdout:95 write 0xc3ef054 thru 0xc3f782f (0x87dc bytes) 2024-09-21T13:58:25.874 INFO:teuthology.orchestra.run.smithi079.stdout:96 write 0x2881116 thru 0x288dc1f (0xcb0a bytes) 2024-09-21T13:58:25.881 INFO:teuthology.orchestra.run.smithi079.stdout:97 trunc from 0xe83419b to 0xd18ce1c 2024-09-21T13:58:25.895 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:25.895 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:25.905 INFO:teuthology.orchestra.run.smithi079.stdout:98 writesame 0x34d21b7 thru 0x34d81ea data_size 0x4(0x6034 bytes) 2024-09-21T13:58:25.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:25.912 INFO:teuthology.orchestra.run.smithi079.stdout:99 read 0x754867b thru 0x754c730 (0x40b6 bytes) 2024-09-21T13:58:25.912 INFO:teuthology.orchestra.run.smithi079.stdout:100 punch from 0xba37603 to 0xba40674, (0x9071 bytes) 2024-09-21T13:58:25.912 INFO:teuthology.orchestra.run.smithi079.stdout:101 writesame 0xd69d95 thru 0xd77135 data_size 0x1(0xd3a1 bytes) 2024-09-21T13:58:25.928 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:25.928 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T13:58:25.928 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:25.946 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.946 INFO:teuthology.orchestra.run.smithi079.stdout:105 write 0x308a581 thru 0x30952ac (0xad2c bytes) 2024-09-21T13:58:25.952 INFO:teuthology.orchestra.run.smithi079.stdout:107 trunc from 0xd18ce1c to 0xd0e4266 2024-09-21T13:58:25.961 INFO:teuthology.orchestra.run.smithi079.stdout:108 punch from 0x2f86a2e to 0x2f8c7f5, (0x5dc7 bytes) 2024-09-21T13:58:25.961 INFO:teuthology.orchestra.run.smithi079.stdout:109 read 0x70a7fd4 thru 0x70ae52e (0x655b bytes) 2024-09-21T13:58:25.967 INFO:teuthology.orchestra.run.smithi079.stdout:110 writesame 0xd3e0960 thru 0xd3e3c78 data_size 0x1(0x3319 bytes) 2024-09-21T13:58:25.968 INFO:teuthology.orchestra.run.smithi079.stdout:111 write 0xb749fdb thru 0xb7559b9 (0xb9df bytes) 2024-09-21T13:58:25.973 INFO:teuthology.orchestra.run.smithi079.stdout:112 writesame 0xa7feed8 thru 0xa80d609 data_size 0x65(0xe732 bytes) 2024-09-21T13:58:25.979 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.979 INFO:teuthology.orchestra.run.smithi079.stdout:114 writesame 0x616c537 thru 0x616fc82 data_size 0x2(0x374c bytes) 2024-09-21T13:58:25.985 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:25.984+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:25.986 INFO:teuthology.orchestra.run.smithi079.stdout:115 read 0x2a0a173 thru 0x2a15b36 (0xb9c4 bytes) 2024-09-21T13:58:25.986 INFO:teuthology.orchestra.run.smithi079.stdout:116 write 0x1721279 thru 0x1730c5a (0xf9e2 bytes) 2024-09-21T13:58:25.988 INFO:teuthology.orchestra.run.smithi079.stdout:117 write 0xbceafd3 thru 0xbcf5e60 (0xae8e bytes) 2024-09-21T13:58:25.990 INFO:teuthology.orchestra.run.smithi079.stdout:118 read 0x954e168 thru 0x955c211 (0xe0aa bytes) 2024-09-21T13:58:25.990 INFO:teuthology.orchestra.run.smithi079.stdout:119 write 0x5d456cd thru 0x5d47c7b (0x25af bytes) 2024-09-21T13:58:25.994 INFO:teuthology.orchestra.run.smithi079.stdout:121 read 0x4b693ab thru 0x4b6f1cc (0x5e22 bytes) 2024-09-21T13:58:25.995 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.995 INFO:teuthology.orchestra.run.smithi079.stdout:125 write 0x50e7df8 thru 0x50ee4b0 (0x66b9 bytes) 2024-09-21T13:58:25.999 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.999 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.999 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.999 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:25.999 INFO:teuthology.orchestra.run.smithi079.stdout:134 write 0x4479262 thru 0x4486310 (0xd0af bytes) 2024-09-21T13:58:26.003 INFO:teuthology.orchestra.run.smithi079.stdout:135 trunc from 0xd3e3c79 to 0xd869822 2024-09-21T13:58:26.008 INFO:teuthology.orchestra.run.smithi079.stdout:137 writesame 0xd342c37 thru 0xd3482c8 data_size 0x7(0x5692 bytes) 2024-09-21T13:58:26.011 INFO:teuthology.orchestra.run.smithi079.stdout:138 writesame 0x54271bd thru 0x5431154 data_size 0x4(0x9f98 bytes) 2024-09-21T13:58:26.019 INFO:teuthology.orchestra.run.smithi079.stdout:139 write 0xbccf50b thru 0xbcdbddb (0xc8d1 bytes) 2024-09-21T13:58:26.021 INFO:teuthology.orchestra.run.smithi079.stdout:140 writesame 0x86af3f1 thru 0x86b1c5f data_size 0x1(0x286f bytes) 2024-09-21T13:58:26.029 INFO:teuthology.orchestra.run.smithi079.stdout:141 read 0xba129e2 thru 0xba17301 (0x4920 bytes) 2024-09-21T13:58:26.042 INFO:teuthology.orchestra.run.smithi079.stdout:142 writesame 0xe3f149e thru 0xe3f5c71 data_size 0x2(0x47d4 bytes) 2024-09-21T13:58:26.043 INFO:teuthology.orchestra.run.smithi079.stdout:143 write 0xc399ea thru 0xc4982a (0xfe41 bytes) 2024-09-21T13:58:26.044 INFO:teuthology.orchestra.run.smithi079.stdout:144 read 0xafcbf97 thru 0xafd8397 (0xc401 bytes) 2024-09-21T13:58:26.044 INFO:teuthology.orchestra.run.smithi079.stdout:146 write 0xc2a9f8f thru 0xc2b0f70 (0x6fe2 bytes) 2024-09-21T13:58:26.047 INFO:teuthology.orchestra.run.smithi079.stdout:147 writesame 0x88e2052 thru 0x88f16da data_size 0x1(0xf689 bytes) 2024-09-21T13:58:26.047 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:26.047+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:26.048 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.048 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:26.095 INFO:teuthology.orchestra.run.smithi079.stdout:149 read 0xbd04077 thru 0xbd0ace9 (0x6c73 bytes) 2024-09-21T13:58:26.096 INFO:teuthology.orchestra.run.smithi079.stdout:151 punch from 0x4240cc2 to 0x425092c, (0xfc6a bytes) 2024-09-21T13:58:26.096 INFO:teuthology.orchestra.run.smithi079.stdout:153 writesame 0xa82fdc1 thru 0xa83777c data_size 0x6a(0x79bc bytes) 2024-09-21T13:58:26.108 INFO:teuthology.orchestra.run.smithi079.stdout:154 trunc from 0xe3f5c72 to 0xa9110f0 2024-09-21T13:58:26.126 INFO:teuthology.orchestra.run.smithi079.stdout:155 read 0x49d8cce thru 0x49e168e (0x89c1 bytes) 2024-09-21T13:58:26.127 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.127 INFO:teuthology.orchestra.run.smithi079.stdout:159 read 0x38c5f5a thru 0x38d2b99 (0xcc40 bytes) 2024-09-21T13:58:26.128 INFO:teuthology.orchestra.run.smithi079.stdout:161 read 0xa31e9d3 thru 0xa329b09 (0xb137 bytes) 2024-09-21T13:58:26.128 INFO:teuthology.orchestra.run.smithi079.stdout:162 read 0x568c085 thru 0x568f667 (0x35e3 bytes) 2024-09-21T13:58:26.132 INFO:teuthology.orchestra.run.smithi079.stdout:163 trunc from 0xa9110f0 to 0xbe79a6c 2024-09-21T13:58:26.141 INFO:teuthology.orchestra.run.smithi079.stdout:164 writesame 0x62d30ab thru 0x62e2a51 data_size 0x1(0xf9a7 bytes) 2024-09-21T13:58:26.148 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:26.147+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:26.167 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:58:26.188 INFO:teuthology.orchestra.run.smithi079.stdout:166 writesame 0x80e3d54 thru 0x80e5e21 data_size 0x22(0x20ce bytes) 2024-09-21T13:58:26.195 INFO:teuthology.orchestra.run.smithi079.stdout:167 write 0xa2ae16b thru 0xa2b7b05 (0x999b bytes) 2024-09-21T13:58:26.200 INFO:teuthology.orchestra.run.smithi079.stdout:168 write 0xaa59600 thru 0xaa5ea17 (0x5418 bytes) 2024-09-21T13:58:26.206 INFO:teuthology.orchestra.run.smithi079.stdout:170 writesame 0xa40044a thru 0xa40c1f1 data_size 0xa8(0xbda8 bytes) 2024-09-21T13:58:26.208 INFO:teuthology.orchestra.run.smithi079.stdout:171 writesame 0x5704fb7 thru 0x5707a16 data_size 0x20(0x2a60 bytes) 2024-09-21T13:58:26.215 INFO:teuthology.orchestra.run.smithi079.stdout:172 punch from 0x821520 to 0x82bb23, (0xa603 bytes) 2024-09-21T13:58:26.215 INFO:teuthology.orchestra.run.smithi079.stdout:173 read 0x81dbfd3 thru 0x81e8053 (0xc081 bytes) 2024-09-21T13:58:26.215 INFO:teuthology.orchestra.run.smithi079.stdout:174 read 0xb8502b9 thru 0xb857cf9 (0x7a41 bytes) 2024-09-21T13:58:26.215 INFO:teuthology.orchestra.run.smithi079.stdout:175 write 0x4e8966b thru 0x4e94fbd (0xb953 bytes) 2024-09-21T13:58:26.217 INFO:teuthology.orchestra.run.smithi079.stdout:176 write 0x2b30fea thru 0x2b3ee96 (0xdead bytes) 2024-09-21T13:58:26.224 INFO:teuthology.orchestra.run.smithi079.stdout:177 trunc from 0xbe79a6c to 0x976e71d 2024-09-21T13:58:26.234 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.234 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.239 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:26.250 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:26.247+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:26.259 INFO:teuthology.orchestra.run.smithi079.stdout:180 write 0xd92a664 thru 0xd934504 (0x9ea1 bytes) 2024-09-21T13:58:26.265 INFO:teuthology.orchestra.run.smithi079.stdout:181 read 0x23f7e8b thru 0x23fb7de (0x3954 bytes) 2024-09-21T13:58:26.265 INFO:teuthology.orchestra.run.smithi079.stdout:182 read 0x2eb05d5 thru 0x2ebf1a5 (0xebd1 bytes) 2024-09-21T13:58:26.265 INFO:teuthology.orchestra.run.smithi079.stdout:184 read 0x39ce4e1 thru 0x39d5f71 (0x7a91 bytes) 2024-09-21T13:58:26.266 INFO:teuthology.orchestra.run.smithi079.stdout:188 writesame 0x9de0bc thru 0x9ede4b data_size 0x8(0xfd90 bytes) 2024-09-21T13:58:26.279 INFO:teuthology.orchestra.run.smithi079.stdout:189 read 0x56ea72b thru 0x56f94d4 (0xedaa bytes) 2024-09-21T13:58:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:190 read 0xb57764e thru 0xb57d80b (0x61be bytes) 2024-09-21T13:58:26.280 INFO:teuthology.orchestra.run.smithi079.stdout:191 read 0xc43b0a1 thru 0xc4449db (0x993b bytes) 2024-09-21T13:58:26.300 INFO:teuthology.orchestra.run.smithi079.stdout:192 trunc from 0xd934505 to 0x577f812 2024-09-21T13:58:26.325 INFO:teuthology.orchestra.run.smithi079.stdout:196 write 0x4f84365 thru 0x4f8d41c (0x90b8 bytes) 2024-09-21T13:58:26.332 INFO:teuthology.orchestra.run.smithi079.stdout:197 trunc from 0x577f812 to 0x40e35e2 2024-09-21T13:58:26.350 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:26.347+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:26.351 INFO:teuthology.orchestra.run.smithi079.stdout:198 writesame 0x1c99254 thru 0x1ca4f10 data_size 0x1(0xbcbd bytes) 2024-09-21T13:58:26.373 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.374 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:26.412 INFO:teuthology.orchestra.run.smithi079.stdout:199 write 0x8425a9 thru 0x84abed (0x8645 bytes) 2024-09-21T13:58:26.433 INFO:teuthology.orchestra.run.smithi079.stdout:200 trunc from 0x40e35e2 to 0xb80006b 2024-09-21T13:58:26.444 INFO:teuthology.orchestra.run.smithi079.stdout:201 writesame 0x97f011a thru 0x97f0cee data_size 0x1(0xbd5 bytes) 2024-09-21T13:58:26.450 INFO:teuthology.orchestra.run.smithi079.stdout:202 read 0x1730976 thru 0x173af5b (0xa5e6 bytes) 2024-09-21T13:58:26.450 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:26.451+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:26.451 INFO:teuthology.orchestra.run.smithi079.stdout:204 punch from 0x4ef7748 to 0x4f02dd5, (0xb68d bytes) 2024-09-21T13:58:26.451 INFO:teuthology.orchestra.run.smithi079.stdout:205 read 0xa3a1da5 thru 0xa3a2616 (0x872 bytes) 2024-09-21T13:58:26.451 INFO:teuthology.orchestra.run.smithi079.stdout:206 write 0xbae2a6 thru 0xbbc931 (0xe68c bytes) 2024-09-21T13:58:26.454 INFO:teuthology.orchestra.run.smithi079.stdout:207 write 0x6d58776 thru 0x6d5a4c8 (0x1d53 bytes) 2024-09-21T13:58:26.460 INFO:teuthology.orchestra.run.smithi079.stdout:208 read 0x95e35ab thru 0x95f10af (0xdb05 bytes) 2024-09-21T13:58:26.462 INFO:teuthology.orchestra.run.smithi079.stdout:209 writesame 0x5b1da6d thru 0x5b235fa data_size 0x1(0x5b8e bytes) 2024-09-21T13:58:26.498 INFO:teuthology.orchestra.run.smithi079.stdout:210 writesame 0x2242fc2 thru 0x224de0d data_size 0x2e(0xae4c bytes) 2024-09-21T13:58:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:211 punch from 0x29b5516 to 0x29b72d9, (0x1dc3 bytes) 2024-09-21T13:58:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:212 read 0x438df9d thru 0x439916b (0xb1cf bytes) 2024-09-21T13:58:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:216 write 0x7719aab thru 0x7726429 (0xc97f bytes) 2024-09-21T13:58:26.512 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.512 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.514 INFO:teuthology.orchestra.run.smithi079.stdout:218 write 0x9eac457 thru 0x9eb0b9c (0x4746 bytes) 2024-09-21T13:58:26.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:26.537 INFO:teuthology.orchestra.run.smithi079.stdout:219 trunc from 0xb80006b to 0x5b40695 2024-09-21T13:58:26.551 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:26.551+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:26.558 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.558 INFO:teuthology.orchestra.run.smithi079.stdout:222 read 0x13a96a1 thru 0x13b63d3 (0xcd33 bytes) 2024-09-21T13:58:26.572 INFO:teuthology.orchestra.run.smithi079.stdout:223 write 0x7225994 thru 0x7231507 (0xbb74 bytes) 2024-09-21T13:58:26.580 INFO:teuthology.orchestra.run.smithi079.stdout:224 read 0x44be946 thru 0x44c130a (0x29c5 bytes) 2024-09-21T13:58:26.580 INFO:teuthology.orchestra.run.smithi079.stdout:225 read 0x84e169 thru 0x859167 (0xafff bytes) 2024-09-21T13:58:26.596 INFO:teuthology.orchestra.run.smithi079.stdout:226 trunc from 0x7231508 to 0xa37c8e 2024-09-21T13:58:26.648 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.648 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.652 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:26.651+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:26.656 INFO:teuthology.orchestra.run.smithi079.stdout:227 writesame 0x80dc3e9 thru 0x80e4987 data_size 0x1(0x859f bytes) 2024-09-21T13:58:26.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:26.669 INFO:teuthology.orchestra.run.smithi079.stdout:228 writesame 0x8a0632d thru 0x8a14030 data_size 0xcd(0xdd04 bytes) 2024-09-21T13:58:26.669 INFO:teuthology.orchestra.run.smithi079.stdout:229 read 0x14b4b90 thru 0x14c1e26 (0xd297 bytes) 2024-09-21T13:58:26.670 INFO:teuthology.orchestra.run.smithi079.stdout:231 write 0x4b83b89 thru 0x4b90d75 (0xd1ed bytes) 2024-09-21T13:58:26.676 INFO:teuthology.orchestra.run.smithi079.stdout:232 writesame 0x1c3fc2c thru 0x1c41ad5 data_size 0x19(0x1eaa bytes) 2024-09-21T13:58:26.684 INFO:teuthology.orchestra.run.smithi079.stdout:233 punch from 0x4ca23dd to 0x4ca561e, (0x3241 bytes) 2024-09-21T13:58:26.684 INFO:teuthology.orchestra.run.smithi079.stdout:234 read 0x4ca9159 thru 0x4cb7425 (0xe2cd bytes) 2024-09-21T13:58:26.684 INFO:teuthology.orchestra.run.smithi079.stdout:235 write 0x85acf7d thru 0x85bbc7c (0xed00 bytes) 2024-09-21T13:58:26.702 INFO:teuthology.orchestra.run.smithi079.stdout:236 writesame 0x915ce1d thru 0x916c683 data_size 0x7b(0xf867 bytes) 2024-09-21T13:58:26.702 INFO:teuthology.orchestra.run.smithi079.stdout:237 writesame 0x3abcd04 thru 0x3abe70e data_size 0x1(0x1a0b bytes) 2024-09-21T13:58:26.728 INFO:teuthology.orchestra.run.smithi079.stdout:238 trunc from 0x916c684 to 0x2fb9e20 2024-09-21T13:58:26.752 INFO:teuthology.orchestra.run.smithi079.stdout:239 read 0xa70273 thru 0xa77ba0 (0x792e bytes) 2024-09-21T13:58:26.753 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.753 INFO:teuthology.orchestra.run.smithi079.stdout:241 read 0x2828926 thru 0x282d81a (0x4ef5 bytes) 2024-09-21T13:58:26.753 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.753 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:26.751+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:26.787 INFO:teuthology.orchestra.run.smithi079.stdout:243 write 0xab1d147 thru 0xab24aa2 (0x795c bytes) 2024-09-21T13:58:26.788 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.789 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:26.817 INFO:teuthology.orchestra.run.smithi079.stdout:244 trunc from 0xab24aa3 to 0x1ede623 2024-09-21T13:58:26.853 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:26.852+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:26.855 INFO:teuthology.orchestra.run.smithi079.stdout:245 trunc from 0x1ede623 to 0x7bcb453 2024-09-21T13:58:26.868 INFO:teuthology.orchestra.run.smithi079.stdout:247 write 0x6165b68 thru 0x6168641 (0x2ada bytes) 2024-09-21T13:58:26.876 INFO:teuthology.orchestra.run.smithi079.stdout:248 read 0x1a6543c thru 0x1a7398e (0xe553 bytes) 2024-09-21T13:58:26.876 INFO:teuthology.orchestra.run.smithi079.stdout:250 read 0x752d6d2 thru 0x75357f2 (0x8121 bytes) 2024-09-21T13:58:26.876 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:26.876 INFO:teuthology.orchestra.run.smithi079.stdout:252 write 0x6fb7f75 thru 0x6fc30fb (0xb187 bytes) 2024-09-21T13:58:26.899 INFO:teuthology.orchestra.run.smithi079.stdout:254 trunc from 0x7bcb453 to 0x18f9f56 2024-09-21T13:58:26.927 INFO:teuthology.orchestra.run.smithi079.stdout:256 read 0x13e6ab4 thru 0x13e9ddb (0x3328 bytes) 2024-09-21T13:58:26.927 INFO:teuthology.orchestra.run.smithi079.stdout:257 read 0x941d9c thru 0x951366 (0xf5cb bytes) 2024-09-21T13:58:26.930 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:26.930 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:26.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:26.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:26.948 INFO:teuthology.orchestra.run.smithi079.stdout:258 write 0x36fa75d thru 0x370184a (0x70ee bytes) 2024-09-21T13:58:26.956 INFO:teuthology.orchestra.run.smithi079.stdout:260 punch from 0xd1e518 to 0xd2c718, (0xe200 bytes) 2024-09-21T13:58:26.966 INFO:teuthology.orchestra.run.smithi079.stdout:262 trunc from 0x370184b to 0x838d084 2024-09-21T13:58:26.980 INFO:teuthology.orchestra.run.smithi079.stdout:263 write 0x3723389 thru 0x372f8a5 (0xc51d bytes) 2024-09-21T13:58:26.983 INFO:teuthology.orchestra.run.smithi079.stdout:264 read 0x2301c53 thru 0x23096a5 (0x7a53 bytes) 2024-09-21T13:58:26.985 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:26.984+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:27.000 INFO:teuthology.orchestra.run.smithi079.stdout:265 write 0xd1df196 thru 0xd1ecca7 (0xdb12 bytes) 2024-09-21T13:58:27.005 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.005 INFO:teuthology.orchestra.run.smithi079.stdout:267 read 0x52cf9ab thru 0x52daf5b (0xb5b1 bytes) 2024-09-21T13:58:27.005 INFO:teuthology.orchestra.run.smithi079.stdout:271 writesame 0x4c95fa thru 0x4d00ac data_size 0xf(0x6ab3 bytes) 2024-09-21T13:58:27.008 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.008 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.008 INFO:teuthology.orchestra.run.smithi079.stdout:275 read 0x9b3a50c thru 0x9b3e564 (0x4059 bytes) 2024-09-21T13:58:27.008 INFO:teuthology.orchestra.run.smithi079.stdout:277 write 0x6728b4e thru 0x672f2c4 (0x6777 bytes) 2024-09-21T13:58:27.013 INFO:teuthology.orchestra.run.smithi079.stdout:278 read 0x3c48fb0 thru 0x3c52087 (0x90d8 bytes) 2024-09-21T13:58:27.013 INFO:teuthology.orchestra.run.smithi079.stdout:279 writesame 0xd339a3 thru 0xd3b8eb data_size 0x7(0x7f49 bytes) 2024-09-21T13:58:27.023 INFO:teuthology.orchestra.run.smithi079.stdout:280 punch from 0x5263ee0 to 0x5271cea, (0xde0a bytes) 2024-09-21T13:58:27.023 INFO:teuthology.orchestra.run.smithi079.stdout:281 write 0xbb1c4db thru 0xbb29aad (0xd5d3 bytes) 2024-09-21T13:58:27.028 INFO:teuthology.orchestra.run.smithi079.stdout:282 write 0xc8d43fa thru 0xc8e13ce (0xcfd5 bytes) 2024-09-21T13:58:27.033 INFO:teuthology.orchestra.run.smithi079.stdout:286 read 0xc5136b thru 0xc603c2 (0xf058 bytes) 2024-09-21T13:58:27.034 INFO:teuthology.orchestra.run.smithi079.stdout:287 writesame 0x97deb27 thru 0x97e7358 data_size 0x75(0x8832 bytes) 2024-09-21T13:58:27.039 INFO:teuthology.orchestra.run.smithi079.stdout:288 punch from 0xaf3ff19 to 0xaf43e38, (0x3f1f bytes) 2024-09-21T13:58:27.039 INFO:teuthology.orchestra.run.smithi079.stdout:289 write 0xae6897d thru 0xae774e7 (0xeb6b bytes) 2024-09-21T13:58:27.045 INFO:teuthology.orchestra.run.smithi079.stdout:290 punch from 0x3096431 to 0x30a4743, (0xe312 bytes) 2024-09-21T13:58:27.046 INFO:teuthology.orchestra.run.smithi079.stdout:291 write 0x108f3ca thru 0x1092fde (0x3c15 bytes) 2024-09-21T13:58:27.050 INFO:teuthology.orchestra.run.smithi079.stdout:292 write 0x18440d1 thru 0x18523ef (0xe31f bytes) 2024-09-21T13:58:27.055 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:27.055+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:27.056 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.056 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.056 INFO:teuthology.orchestra.run.smithi079.stdout:295 read 0xcf7d755 thru 0xcf8be1e (0xe6ca bytes) 2024-09-21T13:58:27.056 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.057 INFO:teuthology.orchestra.run.smithi079.stdout:298 punch from 0xcdf3321 to 0xcdf9d1d, (0x69fc bytes) 2024-09-21T13:58:27.057 INFO:teuthology.orchestra.run.smithi079.stdout:299 read 0x887300d thru 0x887692e (0x3922 bytes) 2024-09-21T13:58:27.057 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.057 INFO:teuthology.orchestra.run.smithi079.stdout:302 write 0xbcfa0e0 thru 0xbcfc434 (0x2355 bytes) 2024-09-21T13:58:27.060 INFO:teuthology.orchestra.run.smithi079.stdout:303 read 0x49ac33f thru 0x49b9e2b (0xdaed bytes) 2024-09-21T13:58:27.060 INFO:teuthology.orchestra.run.smithi079.stdout:304 read 0x6fcbbb1 thru 0x6fd59cf (0x9e1f bytes) 2024-09-21T13:58:27.060 INFO:teuthology.orchestra.run.smithi079.stdout:305 write 0xa9e9950 thru 0xa9f4bee (0xb29f bytes) 2024-09-21T13:58:27.065 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.065 INFO:teuthology.orchestra.run.smithi079.stdout:308 read 0xadd7318 thru 0xade4849 (0xd532 bytes) 2024-09-21T13:58:27.066 INFO:teuthology.orchestra.run.smithi079.stdout:309 read 0xa9d5665 thru 0xa9d8d71 (0x370d bytes) 2024-09-21T13:58:27.067 INFO:teuthology.orchestra.run.smithi079.stdout:310 punch from 0x5ca5078 to 0x5cb287c, (0xd804 bytes) 2024-09-21T13:58:27.067 INFO:teuthology.orchestra.run.smithi079.stdout:312 write 0x7155c77 thru 0x715e4fa (0x8884 bytes) 2024-09-21T13:58:27.072 INFO:teuthology.orchestra.run.smithi079.stdout:315 punch from 0x4f7886e to 0x4f78a9f, (0x231 bytes) 2024-09-21T13:58:27.072 INFO:teuthology.orchestra.run.smithi079.stdout:317 write 0x2776baa thru 0x27799da (0x2e31 bytes) 2024-09-21T13:58:27.089 INFO:teuthology.orchestra.run.smithi079.stdout:318 trunc from 0xd1ecca8 to 0x4a1817c 2024-09-21T13:58:27.098 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:27.099 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:27.104 INFO:teuthology.orchestra.run.smithi079.stdout:319 read 0x3c1fe28 thru 0x3c2c22e (0xc407 bytes) 2024-09-21T13:58:27.116 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:27.117 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:27.118 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:27.118 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:27.119 INFO:teuthology.orchestra.run.smithi079.stdout:321 write 0x7c52476 thru 0x7c54c27 (0x27b2 bytes) 2024-09-21T13:58:27.123 INFO:teuthology.orchestra.run.smithi079.stdout:322 write 0x23f279a thru 0x24021a6 (0xfa0d bytes) 2024-09-21T13:58:27.127 INFO:teuthology.orchestra.run.smithi079.stdout:323 read 0x2aaf744 thru 0x2ab1c89 (0x2546 bytes) 2024-09-21T13:58:27.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:27.135 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:27.141 INFO:teuthology.orchestra.run.smithi079.stdout:324 write 0xbdf697b thru 0xbdf9d9c (0x3422 bytes) 2024-09-21T13:58:27.148 INFO:teuthology.orchestra.run.smithi079.stdout:326 read 0x9c6ce26 thru 0x9c73bdc (0x6db7 bytes) 2024-09-21T13:58:27.149 INFO:teuthology.orchestra.run.smithi079.stdout:327 punch from 0x5ff3cba to 0x5ff6829, (0x2b6f bytes) 2024-09-21T13:58:27.149 INFO:teuthology.orchestra.run.smithi079.stdout:328 read 0x338fe95 thru 0x339729d (0x7409 bytes) 2024-09-21T13:58:27.150 INFO:teuthology.orchestra.run.smithi079.stdout:329 read 0x3f05dc1 thru 0x3f10879 (0xaab9 bytes) 2024-09-21T13:58:27.150 INFO:teuthology.orchestra.run.smithi079.stdout:330 read 0x1c27e7f thru 0x1c32e22 (0xafa4 bytes) 2024-09-21T13:58:27.150 INFO:teuthology.orchestra.run.smithi079.stdout:332 writesame 0x58cc24c thru 0x58d0900 data_size 0x1(0x46b5 bytes) 2024-09-21T13:58:27.154 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:27.155 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:27.155 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:27.155+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:27.158 INFO:teuthology.orchestra.run.smithi079.stdout:333 write 0xeed935 thru 0xef907c (0xb748 bytes) 2024-09-21T13:58:27.160 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:27.160 INFO:teuthology.orchestra.run.smithi079.stdout:335 write 0x84cdbbd thru 0x84d0943 (0x2d87 bytes) 2024-09-21T13:58:27.165 INFO:teuthology.orchestra.run.smithi079.stdout:336 writesame 0x9272707 thru 0x9275e98 data_size 0x3(0x3792 bytes) 2024-09-21T13:58:27.180 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:27.180 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:27.183 INFO:teuthology.orchestra.run.smithi079.stdout:338 trunc from 0xbdf9d9d to 0x38af925 2024-09-21T13:58:27.194 INFO:teuthology.orchestra.run.smithi079.stdout:341 clone 1 order 21 su 1048576 sc 7 2024-09-21T13:58:27.200 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:27.201 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:27.219 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:27.219 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:27.238 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:27.238 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:27.255 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:27.252+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:27.262 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:27.262 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:27.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:27.262 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [] 2024-09-21T13:58:27.263 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:27.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:27.361 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:27.360+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:27.442 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:27.442 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:27.442 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:27.442 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:27.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:27.497 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:27.496+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:27.559 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:27.556+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:27.621 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:27.621 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:27.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:27.677 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:27.676+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:27.762 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:27.763+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.582517959, 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011514554, 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 107 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219217+0000", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219216+0000", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219223+0000", 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5429999999999999e-06 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219233+0000", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7399999999999999e-06 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219240+0000", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6229999999999997e-06 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223392+0000", 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041511999999999999 2024-09-21T13:58:27.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223612+0000", 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022086999999999999 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.223941+0000", 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032844299999999999 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226699+0000", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027585000000000001 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230510+0000", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038104269999999999 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230626+0000", 2024-09-21T13:58:27.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115952 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230732+0000", 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106136 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.582071388999999, 2024-09-21T13:58:27.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012741621999999999, 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 108 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219664+0000", 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219662+0000", 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219673+0000", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.062e-05 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219692+0000", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8712999999999999e-05 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219705+0000", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3599e-05 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225447+0000", 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005741833 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225577+0000", 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130376 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.225789+0000", 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021166199999999999 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229333+0000", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035441320000000002 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232267+0000", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029338179999999999 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232348+0000", 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1382000000000001e-05 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232405+0000", 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7166999999999997e-05 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581984222999999, 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012774071, 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 109 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219751+0000", 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219750+0000", 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219907+0000", 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156403 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219921+0000", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.482e-05 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219931+0000", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4360000000000008e-06 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226781+0000", 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0068506069999999999 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.226919+0000", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137429 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.227152+0000", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000233162 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232127+0000", 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049746449999999998 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232424+0000", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000297034 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232482+0000", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8122999999999999e-05 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232525+0000", 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3235999999999997e-05 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581792938, 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012742565000000001, 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219942+0000", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219948+0000", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1229999999999997e-06 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219957+0000", 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7629999999999995e-06 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219965+0000", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.396e-06 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228375+0000", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084096299999999995 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228500+0000", 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125439 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.228691+0000", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019109800000000001 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232251+0000", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035597889999999998 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232567+0000", 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031582399999999998 2024-09-21T13:58:27.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232626+0000", 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9777e-05 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232685+0000", 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8458999999999997e-05 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581762048999998, 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013935693000000001, 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 111 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219973+0000", 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219978+0000", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5459999999999999e-06 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.219993+0000", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5347000000000001e-05 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220005+0000", 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1742999999999999e-05 2024-09-21T13:58:27.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229422+0000", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094169749999999993 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229559+0000", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013675199999999999 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.229808+0000", 2024-09-21T13:58:27.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024875800000000002 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232834+0000", 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030260259999999998 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233795+0000", 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00096086000000000001 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233858+0000", 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3195999999999996e-05 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233909+0000", 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1136e-05 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581682135000001, 2024-09-21T13:58:27.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014946408, 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 112 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220053+0000", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220052+0000", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220244+0000", 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019178199999999999 2024-09-21T13:58:27.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220267+0000", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3200000000000001e-05 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220284+0000", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7269999999999999e-05 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230829+0000", 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010545362000000001 2024-09-21T13:58:27.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.230982+0000", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015277199999999999 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.231238+0000", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025577400000000001 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233998+0000", 2024-09-21T13:58:27.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027597860000000002 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234878+0000", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088049999999999999 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234945+0000", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6863e-05 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235000+0000", 2024-09-21T13:58:27.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4353e-05 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581430864000001, 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017429495999999999, 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220304+0000", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220303+0000", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220314+0000", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0713000000000001e-05 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220335+0000", 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1022999999999998e-05 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220351+0000", 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6243e-05 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.232917+0000", 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012565679999999999 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233050+0000", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013379599999999999 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.233241+0000", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190745 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237560+0000", 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043189669999999999 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237579+0000", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8963000000000001e-05 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237664+0000", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5255999999999998e-05 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237734+0000", 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9480000000000006e-05 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581367565000001, 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017968921999999998, 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 114 2024-09-21T13:58:27.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220368+0000", 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220367+0000", 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220399+0000", 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999997e-05 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220418+0000", 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8595999999999999e-05 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220433+0000", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5227e-05 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234073+0000", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013639642 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234189+0000", 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116482 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.234366+0000", 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017661900000000001 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.237899+0000", 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035332760000000001 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238094+0000", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019485800000000001 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238227+0000", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133196 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238337+0000", 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109249 2024-09-21T13:58:27.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581275585, 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018118983000000002, 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.851 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 115 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220460+0000", 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220458+0000", 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220640+0000", 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018189500000000001 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220657+0000", 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6385999999999999e-05 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220667+0000", 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9839999999999996e-06 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235066+0000", 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014399646 2024-09-21T13:58:27.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235198+0000", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013142199999999999 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.235474+0000", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027618800000000002 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238069+0000", 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025946929999999999 2024-09-21T13:58:27.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238356+0000", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028751800000000001 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238487+0000", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013092900000000001 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238579+0000", 2024-09-21T13:58:27.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1651999999999996e-05 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581055704000001, 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019065693000000002, 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 116 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220680+0000", 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220679+0000", 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220685+0000", 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5130000000000002e-06 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220695+0000", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0087e-05 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220703+0000", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236459+0000", 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015756791999999999 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236637+0000", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017799800000000001 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.236824+0000", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018612899999999999 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239484+0000", 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026603590000000002 2024-09-21T13:58:27.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239505+0000", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1250000000000002e-05 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239639+0000", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013371600000000001 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239745+0000", 2024-09-21T13:58:27.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010642200000000001 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.581023940000001, 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019735127000000002, 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 117 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220711+0000", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220730+0000", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9113000000000001e-05 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220741+0000", 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1076e-05 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.220749+0000", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6499999999999996e-06 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238669+0000", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017920609000000001 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.238805+0000", 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013605900000000001 2024-09-21T13:58:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.239009+0000", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020428199999999999 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240104+0000", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010946669999999999 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240316+0000", 2024-09-21T13:58:27.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000211416 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240390+0000", 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4308999999999996e-05 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.240446+0000", 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6606e-05 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.082163517000001, 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011537083, 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 135 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719572+0000", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719570+0000", 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:27.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719590+0000", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9083e-05 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719616+0000", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.618e-05 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719657+0000", 2024-09-21T13:58:27.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1452999999999998e-05 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722519+0000", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002861653 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722607+0000", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8500999999999999e-05 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.722744+0000", 2024-09-21T13:58:27.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137136 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724971+0000", 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022261360000000001 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731059+0000", 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060883100000000004 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731087+0000", 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8371e-05 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731109+0000", 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.156e-05 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:27.874 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.082055085, 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011491291000000001, 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719680+0000", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719679+0000", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719690+0000", 2024-09-21T13:58:27.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1212999999999999e-05 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719716+0000", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5837e-05 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719733+0000", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7499999999999998e-05 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723127+0000", 2024-09-21T13:58:27.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033932630000000001 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723182+0000", 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5408999999999998e-05 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723278+0000", 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5713999999999999e-05 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726316+0000", 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003038266 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731132+0000", 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004815639 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731154+0000", 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2734e-05 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731171+0000", 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7099e-05 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.081979717999999, 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013736454, 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 137 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719756+0000", 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719754+0000", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719883+0000", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012819200000000001 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719900+0000", 2024-09-21T13:58:27.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7079999999999999e-05 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719924+0000", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4142999999999999e-05 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723694+0000", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037706620000000001 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723785+0000", 2024-09-21T13:58:27.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0116000000000003e-05 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.723864+0000", 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9505999999999994e-05 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728675+0000", 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048111040000000001 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733449+0000", 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047735390000000003 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733473+0000", 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3747000000000002e-05 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733492+0000", 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9494999999999999e-05 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.081798623000001, 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013630234999999999, 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 138 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719937+0000", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719936+0000", 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719942+0000", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5030000000000002e-06 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719970+0000", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7603999999999999e-05 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719978+0000", 2024-09-21T13:58:27.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2959999999999999e-06 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724443+0000", 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044649080000000001 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724562+0000", 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118934 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.724681+0000", 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011854900000000001 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728718+0000", 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004037461 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733525+0000", 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048072929999999998 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733549+0000", 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3524999999999999e-05 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733567+0000", 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7969e-05 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.081747972999999, 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013651037, 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719987+0000", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.719992+0000", 2024-09-21T13:58:27.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000001e-06 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720003+0000", 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1026000000000001e-05 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720011+0000", 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725002+0000", 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049909619999999998 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725050+0000", 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8528e-05 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725128+0000", 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7478000000000006e-05 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.728748+0000", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036200719999999998 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733599+0000", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048515759999999998 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733621+0000", 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1515e-05 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733638+0000", 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7606000000000001e-05 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.081716700000001, 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013681027, 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 140 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720019+0000", 2024-09-21T13:58:27.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720018+0000", 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720109+0000", 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1415999999999993e-05 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720122+0000", 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2523e-05 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720130+0000", 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2770000000000005e-06 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725655+0000", 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055245240000000003 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725703+0000", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8680000000000001e-05 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.725815+0000", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011137399999999999 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731304+0000", 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054890980000000004 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733661+0000", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002356763 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733683+0000", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2052000000000002e-05 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.733700+0000", 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6986999999999998e-05 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.081594281000001, 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013987249, 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 141 2024-09-21T13:58:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720141+0000", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720140+0000", 2024-09-21T13:58:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720146+0000", 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9499999999999998e-06 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720156+0000", 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9229999999999997e-06 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.720166+0000", 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0146000000000001e-05 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726335+0000", 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061690859999999998 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726379+0000", 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3435e-05 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.726449+0000", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9788000000000003e-05 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.731322+0000", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048735330000000002 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734089+0000", 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002766653 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734111+0000", 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2183000000000001e-05 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:07.734128+0000", 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7314999999999999e-05 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-21T13:58:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.364477446999999, 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01296108, 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437258+0000", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437257+0000", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437409+0000", 2024-09-21T13:58:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015206900000000001 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437430+0000", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1107e-05 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437441+0000", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0397000000000001e-05 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443090+0000", 2024-09-21T13:58:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056497759999999996 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443259+0000", 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016870500000000001 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.443448+0000", 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018835499999999999 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.445870+0000", 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024222219999999999 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450086+0000", 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042161070000000002 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450157+0000", 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1277000000000002e-05 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450219+0000", 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1742000000000006e-05 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.364276262000001, 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01305037, 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4195", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.134:0/2855921116", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 159 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437459+0000", 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437458+0000", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437465+0000", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5200000000000003e-06 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437475+0000", 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.023e-05 2024-09-21T13:58:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.437482+0000", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2060000000000001e-06 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444668+0000", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071858080000000001 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444788+0000", 2024-09-21T13:58:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120252 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.444983+0000", 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000194969 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.446570+0000", 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001586861 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450332+0000", 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037621909999999998 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450447+0000", 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114972 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:08.450509+0000", 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2197000000000001e-05 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:27.920 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:27.921 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:27.920+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:27.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:28.023 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:28.023+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:28.052 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.052 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:28.052 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:28.052 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:28.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:28.154 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:28.155+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:28.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:58:28.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:28.235+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:28.237 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:28.237 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:28.237 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:28.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:28.325 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:28.324+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:28.393 INFO:teuthology.orchestra.run.smithi079.stdout:342 write 0x9d7b16c thru 0x9d802dc (0x5171 bytes) 2024-09-21T13:58:28.417 INFO:teuthology.orchestra.run.smithi079.stdout:343 write 0xc466af3 thru 0xc4684b3 (0x19c1 bytes) 2024-09-21T13:58:28.422 INFO:teuthology.orchestra.run.smithi079.stdout:344 read 0x1033d78 thru 0x103e4f4 (0xa77d bytes) 2024-09-21T13:58:28.424 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.459526554, 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051845399999999996, 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964058+0000", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964141+0000", 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3331999999999994e-05 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964162+0000", 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1056999999999998e-05 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964190+0000", 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8243e-05 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964261+0000", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0458999999999997e-05 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964293+0000", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2270000000000001e-05 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969166+0000", 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048727919999999999 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969243+0000", 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7516999999999997e-05 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.457257795, 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050517169999999998, 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966326+0000", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966337+0000", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0256e-05 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966358+0000", 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1063000000000001e-05 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966370+0000", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2724e-05 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966469+0000", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8921999999999999e-05 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966508+0000", 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.888e-05 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971275+0000", 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047667059999999999 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971379+0000", 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104286 2024-09-21T13:58:28.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.397189603000001, 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053209900000000003, 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026394+0000", 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026419+0000", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5256e-05 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026443+0000", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3842999999999999e-05 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026455+0000", 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2207e-05 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027293+0000", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00083795300000000001 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027352+0000", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.91e-05 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031648+0000", 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042961600000000003 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031717+0000", 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8167e-05 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:129 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'87, mlcod=16'85)", 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.704199160999998, 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049320420000000002, 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719386+0000", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719384+0000", 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719398+0000", 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3283e-05 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719427+0000", 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000001e-05 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719445+0000", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8034e-05 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719536+0000", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1428999999999995e-05 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.719574+0000", 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7799999999999997e-05 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724235+0000", 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004660717 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724318+0000", 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3228999999999999e-05 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:132 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'90, mlcod=16'85)", 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.702673819000001, 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056392600000000001, 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720910+0000", 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720925+0000", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4773000000000001e-05 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720947+0000", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1953000000000001e-05 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720961+0000", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4446e-05 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722303+0000", 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013414729999999999 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722362+0000", 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726455+0000", 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040928379999999997 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726551+0000", 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5649999999999994e-05 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:133 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'91, mlcod=16'85)", 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.702058244, 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075400450000000004, 2024-09-21T13:58:28.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721526+0000", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721538+0000", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-05 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721567+0000", 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9635999999999999e-05 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721582+0000", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.486e-05 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723342+0000", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017600960000000001 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723402+0000", 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9688999999999997e-05 2024-09-21T13:58:28.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.728990+0000", 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055877940000000001 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729067+0000", 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7236000000000004e-05 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'85)", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.701534098, 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070881590000000001, 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722050+0000", 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722126+0000", 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5774999999999999e-05 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722177+0000", 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1583999999999999e-05 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722196+0000", 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8972999999999999e-05 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724546+0000", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002350071 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724582+0000", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5553000000000003e-05 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729077+0000", 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044949250000000003 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729139+0000", 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2473999999999999e-05 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'85)", 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.70073897, 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079821179999999999, 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722844+0000", 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722858+0000", 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3606e-05 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722886+0000", 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8116e-05 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722899+0000", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2802999999999999e-05 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725603+0000", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704166 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725660+0000", 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6709999999999997e-05 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730755+0000", 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050949139999999999 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730828+0000", 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3592999999999998e-05 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:136 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'85)", 2024-09-21T13:58:28.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.700223558000001, 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075270889999999998, 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:28.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723361+0000", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723371+0000", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0209e-05 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723387+0000", 2024-09-21T13:58:28.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.579e-05 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723400+0000", 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3113e-05 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726660+0000", 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003260092 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726721+0000", 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1116000000000002e-05 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730837+0000", 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041155280000000002 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730889+0000", 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2227e-05 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'85)", 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.699591438999999, 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092100250000000002, 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723993+0000", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724109+0000", 2024-09-21T13:58:28.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115919 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724128+0000", 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9497e-05 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724142+0000", 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3596e-05 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727440+0000", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003298685 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727493+0000", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2973000000000003e-05 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733130+0000", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056365670000000003 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733204+0000", 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3812000000000004e-05 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:138 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'85)", 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.698848032000001, 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085262879999999999, 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724736+0000", 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:28.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724744+0000", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0929999999999997e-06 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724763+0000", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000001e-05 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724848+0000", 2024-09-21T13:58:28.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4746000000000005e-05 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729217+0000", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043694019999999997 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729253+0000", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6096999999999997e-05 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733208+0000", 2024-09-21T13:58:28.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003954323 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733263+0000", 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5779999999999998e-05 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'85)", 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.698398852, 2024-09-21T13:58:28.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081432770000000008, 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725195+0000", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0899999999999994e-06 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725211+0000", 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6863000000000001e-05 2024-09-21T13:58:28.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725221+0000", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0170000000000002e-06 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729879+0000", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046583570000000001 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729934+0000", 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5276999999999999e-05 2024-09-21T13:58:28.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733270+0000", 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033358509999999999 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733330+0000", 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9639000000000003e-05 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'88)", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.697580948999999, 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073847440000000004, 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726002+0000", 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726122+0000", 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119323 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726208+0000", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6458999999999993e-05 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726227+0000", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8666999999999999e-05 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730976+0000", 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004749573 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.731011+0000", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5126999999999998e-05 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733333+0000", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023211389999999998 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733389+0000", 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6465999999999998e-05 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'88)", 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.697062503000001, 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073917740000000003, 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726521+0000", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726535+0000", 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3543000000000001e-05 2024-09-21T13:58:28.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726557+0000", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2160000000000001e-05 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726570+0000", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.287e-05 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732292+0000", 2024-09-21T13:58:28.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057226129999999997 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732349+0000", 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6375999999999997e-05 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733845+0000", 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014963680000000001 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733914+0000", 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9419999999999996e-05 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:156 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'110, mlcod=16'105)", 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.982633213, 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061283630000000004, 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440951+0000", 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440957+0000", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2939999999999996e-06 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440966+0000", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3689999999999996e-06 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440973+0000", 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5339999999999996e-06 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441011+0000", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8824e-05 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441028+0000", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6407999999999999e-05 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.446998+0000", 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059700179999999997 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447080+0000", 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2496000000000004e-05 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:157 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'111, mlcod=16'106)", 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.981345979, 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048843990000000002, 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442239+0000", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442244+0000", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1889999999999998e-06 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442256+0000", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2115e-05 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442262+0000", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8030000000000002e-06 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442296+0000", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3906999999999999e-05 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.442311+0000", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5313999999999999e-05 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447084+0000", 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047726640000000002 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447124+0000", 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0024000000000002e-05 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:158 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'112, mlcod=17'107)", 2024-09-21T13:58:28.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.980025726000001, 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061998649999999997, 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:28.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443660+0000", 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101098 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443669+0000", 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9879999999999993e-06 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443674+0000", 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443708+0000", 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4474999999999998e-05 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443723+0000", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5012e-05 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449688+0000", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059649200000000003 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449759+0000", 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1218999999999997e-05 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:159 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'113, mlcod=17'107)", 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.978511270999999, 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047244330000000001, 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:28.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445074+0000", 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445072+0000", 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445089+0000", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.719e-05 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445114+0000", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.472e-05 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445126+0000", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2156e-05 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445185+0000", 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8566999999999997e-05 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.445215+0000", 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0593000000000003e-05 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449763+0000", 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045475580000000002 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449798+0000", 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5366e-05 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.7521810870000003, 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052270329999999999, 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671402+0000", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671416+0000", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4483e-05 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671442+0000", 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.588e-05 2024-09-21T13:58:28.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671457+0000", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4837999999999999e-05 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671533+0000", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5984999999999998e-05 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671540+0000", 2024-09-21T13:58:28.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6839999999999999e-06 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674569+0000", 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003029402 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674725+0000", 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015601699999999999 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:58:28.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674963+0000", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000237801 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676421+0000", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001457928 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676520+0000", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9550999999999996e-05 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676590+0000", 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9983999999999999e-05 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676631+0000", 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0904e-05 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:690 3.12 3:4eae972e:::rbd_data.1185f0a8fe85.0000000000000016:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:28.509 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.270983762, 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008593046, 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 690 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152606+0000", 2024-09-21T13:58:28.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9660000000000001e-06 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152618+0000", 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1949e-05 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152628+0000", 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9809999999999998e-06 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152668+0000", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9669000000000003e-05 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152719+0000", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1282999999999997e-05 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.154004+0000", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012846909999999999 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161124+0000", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007119495 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161135+0000", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1147e-05 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161168+0000", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3556000000000002e-05 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161194+0000", 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6242999999999999e-05 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.515 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:28.516 INFO:teuthology.orchestra.run.smithi079.stdout:345 writesame 0x5a53d90 thru 0x5a53f4a data_size 0x1(0x1bb bytes) 2024-09-21T13:58:28.516 INFO:teuthology.orchestra.run.smithi079.stdout:346 read 0x83ea85f thru 0x83eb528 (0xcca bytes) 2024-09-21T13:58:28.516 INFO:teuthology.orchestra.run.smithi079.stdout:349 write 0xbd28977 thru 0xbd370d8 (0xe762 bytes) 2024-09-21T13:58:28.516 INFO:teuthology.orchestra.run.smithi079.stdout:350 read 0x14518c4 thru 0x1454bbb (0x32f8 bytes) 2024-09-21T13:58:28.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:351 trunc from 0xc4684b4 to 0x1ed10dd 2024-09-21T13:58:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:352 read 0x12ced79 thru 0x12db1a0 (0xc428 bytes) 2024-09-21T13:58:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:353 trunc from 0x1ed10dd to 0xba5c924 2024-09-21T13:58:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:354 writesame 0x451f7bc thru 0x4526315 data_size 0x5b(0x6b5a bytes) 2024-09-21T13:58:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:355 write 0x4ff4f15 thru 0x5004501 (0xf5ed bytes) 2024-09-21T13:58:28.520 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:28.519+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:28.521 INFO:teuthology.orchestra.run.smithi079.stdout:356 read 0x3034b7 thru 0x303ef8 (0xa42 bytes) 2024-09-21T13:58:28.521 INFO:teuthology.orchestra.run.smithi079.stdout:357 writesame 0x243f918 thru 0x2444ceb data_size 0x4a(0x53d4 bytes) 2024-09-21T13:58:28.523 INFO:teuthology.orchestra.run.smithi079.stdout:358 read 0x40e86b0 thru 0x40f0831 (0x8182 bytes) 2024-09-21T13:58:28.523 INFO:teuthology.orchestra.run.smithi079.stdout:359 writesame 0x996c130 thru 0x9973ea4 data_size 0x1(0x7d75 bytes) 2024-09-21T13:58:28.547 INFO:teuthology.orchestra.run.smithi079.stdout:360 read 0xa21a8eb thru 0xa229fea (0xf700 bytes) 2024-09-21T13:58:28.547 INFO:teuthology.orchestra.run.smithi079.stdout:361 write 0x1f07214 thru 0x1f0d6ff (0x64ec bytes) 2024-09-21T13:58:28.551 INFO:teuthology.orchestra.run.smithi079.stdout:362 write 0xabeb200 thru 0xabf42da (0x90db bytes) 2024-09-21T13:58:28.557 INFO:teuthology.orchestra.run.smithi079.stdout:364 write 0x5303c68 thru 0x5311000 (0xd399 bytes) 2024-09-21T13:58:28.573 INFO:teuthology.orchestra.run.smithi079.stdout:365 write 0xd0c5511 thru 0xd0d4893 (0xf383 bytes) 2024-09-21T13:58:28.578 INFO:teuthology.orchestra.run.smithi079.stdout:366 writesame 0x7cd7a37 thru 0x7cdeb6d data_size 0x1(0x7137 bytes) 2024-09-21T13:58:28.620 INFO:teuthology.orchestra.run.smithi079.stdout:367 write 0x301de78 thru 0x302091b (0x2aa4 bytes) 2024-09-21T13:58:28.620 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:28.616+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:28.626 INFO:teuthology.orchestra.run.smithi079.stdout:368 write 0x5930340 thru 0x593e92e (0xe5ef bytes) 2024-09-21T13:58:28.633 INFO:teuthology.orchestra.run.smithi079.stdout:370 punch from 0xaeb13 to 0xb1239, (0x2726 bytes) 2024-09-21T13:58:28.633 INFO:teuthology.orchestra.run.smithi079.stdout:371 write 0x61285a2 thru 0x6130cf7 (0x8756 bytes) 2024-09-21T13:58:28.640 INFO:teuthology.orchestra.run.smithi079.stdout:373 write 0x48315b thru 0x48ba32 (0x88d8 bytes) 2024-09-21T13:58:28.646 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:28.646 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:28.646 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:28.666 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:28.667 INFO:teuthology.orchestra.run.smithi079.stdout:374 trunc from 0xd0d4894 to 0x4bf9229 2024-09-21T13:58:28.697 INFO:teuthology.orchestra.run.smithi079.stdout:375 read 0x45d6980 thru 0x45d7da8 (0x1429 bytes) 2024-09-21T13:58:28.697 INFO:teuthology.orchestra.run.smithi079.stdout:376 writesame 0x1f0c31c thru 0x1f1b856 data_size 0x1(0xf53b bytes) 2024-09-21T13:58:28.720 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:28.719+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:28.777 INFO:teuthology.orchestra.run.smithi079.stdout:377 write 0x373b40f thru 0x3746a53 (0xb645 bytes) 2024-09-21T13:58:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:378 read 0x111d372 thru 0x1123202 (0x5e91 bytes) 2024-09-21T13:58:28.782 INFO:teuthology.orchestra.run.smithi079.stdout:380 write 0x3a077e0 thru 0x3a122fc (0xab1d bytes) 2024-09-21T13:58:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:28.791 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:28.791 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:28.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:28.822 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:28.820+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:382 write 0xe665739 thru 0xe670bc4 (0xb48c bytes) 2024-09-21T13:58:28.829 INFO:teuthology.orchestra.run.smithi079.stdout:383 writesame 0xcdf38da thru 0xcdfc39a data_size 0x1(0x8ac1 bytes) 2024-09-21T13:58:28.853 INFO:teuthology.orchestra.run.smithi079.stdout:384 punch from 0x2a6feeb to 0x2a75a60, (0x5b75 bytes) 2024-09-21T13:58:28.853 INFO:teuthology.orchestra.run.smithi079.stdout:387 write 0x40c686d thru 0x40d2795 (0xbf29 bytes) 2024-09-21T13:58:28.858 INFO:teuthology.orchestra.run.smithi079.stdout:388 read 0x16310e2 thru 0x16393f8 (0x8317 bytes) 2024-09-21T13:58:28.858 INFO:teuthology.orchestra.run.smithi079.stdout:389 write 0x4be3156 thru 0x4be6735 (0x35e0 bytes) 2024-09-21T13:58:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:391 read 0x1977947 thru 0x1987206 (0xf8c0 bytes) 2024-09-21T13:58:28.864 INFO:teuthology.orchestra.run.smithi079.stdout:393 write 0x502eb33 thru 0x50366d1 (0x7b9f bytes) 2024-09-21T13:58:28.866 INFO:teuthology.orchestra.run.smithi079.stdout:394 writesame 0xe07cc57 thru 0xe084012 data_size 0x12(0x73bc bytes) 2024-09-21T13:58:28.885 INFO:teuthology.orchestra.run.smithi079.stdout:398 trunc from 0xe670bc5 to 0x614227d 2024-09-21T13:58:28.907 INFO:teuthology.orchestra.run.smithi079.stdout:399 write 0x2ceb933 thru 0x2cf52ed (0x99bb bytes) 2024-09-21T13:58:28.912 INFO:teuthology.orchestra.run.smithi079.stdout:400 read 0x34d74df thru 0x34df760 (0x8282 bytes) 2024-09-21T13:58:28.916 INFO:teuthology.orchestra.run.smithi079.stdout:401 trunc from 0x614227d to 0x89f59cf 2024-09-21T13:58:28.922 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:28.923+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:28.926 INFO:teuthology.orchestra.run.smithi079.stdout:402 writesame 0xba5f5a thru 0xbacd4d data_size 0x3e(0x6df4 bytes) 2024-09-21T13:58:28.937 INFO:teuthology.orchestra.run.smithi079.stdout:403 trunc from 0x89f59cf to 0xc5c69da 2024-09-21T13:58:28.948 INFO:teuthology.orchestra.run.smithi079.stdout:404 writesame 0x3f9039d thru 0x3f96c22 data_size 0x2(0x6886 bytes) 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:677 3.4 3:2779e4ec:::rbd_data.1185f0a8fe85.0000000000000008:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4138906~55398] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:27.127163+0000", 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.830240434, 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026042959999999999, 2024-09-21T13:58:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 677 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127163+0000", 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127163+0000", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127163+0000", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127197+0000", 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4486999999999997e-05 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127211+0000", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4115e-05 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127219+0000", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7179999999999996e-06 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127262+0000", 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2843000000000003e-05 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127311+0000", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9144000000000002e-05 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.127393+0000", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1852000000000002e-05 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.128056+0000", 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00066355600000000004 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.129715+0000", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001658351 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.129747+0000", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2614999999999999e-05 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.129768+0000", 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0545000000000001e-05 2024-09-21T13:58:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:687 3.4 3:20a79435:::rbd_object_map.1185f0a8fe85:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:27.144233+0000", 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.81317084, 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027037189999999998, 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 687 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144233+0000", 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144233+0000", 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144232+0000", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144240+0000", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5809999999999997e-06 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144254+0000", 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4175999999999999e-05 2024-09-21T13:58:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144266+0000", 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1717e-05 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144322+0000", 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6264999999999997e-05 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144397+0000", 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4845999999999995e-05 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.144724+0000", 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032638399999999998 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.146646+0000", 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001922013 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.146813+0000", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000166942 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.146869+0000", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6957999999999999e-05 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.146937+0000", 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7292000000000006e-05 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:718 3.4 3:20a79435:::rbd_object_map.1185f0a8fe85:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.199362+0000", 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.75804207499999998, 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002516473, 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 718 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199362+0000", 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199362+0000", 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199359+0000", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199377+0000", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8057e-05 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199409+0000", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2512999999999999e-05 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199426+0000", 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6483000000000001e-05 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199501+0000", 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4661999999999998e-05 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199620+0000", 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119426 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.199936+0000", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031632999999999997 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.201118+0000", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001181274 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.201779+0000", 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00066135399999999996 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.201832+0000", 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3111e-05 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.201878+0000", 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6313000000000002e-05 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:753 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.252868+0000", 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.70453599499999997, 2024-09-21T13:58:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023451610000000001, 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 753 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252868+0000", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252868+0000", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252864+0000", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999962 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252885+0000", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.056e-05 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252926+0000", 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1632999999999999e-05 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.252945+0000", 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8807000000000001e-05 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.253015+0000", 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9344999999999994e-05 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.253204+0000", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000189011 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.253412+0000", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000208746 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.254466+0000", 2024-09-21T13:58:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010541839999999999 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.255125+0000", 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065844600000000003 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.255182+0000", 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7402999999999999e-05 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.255213+0000", 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0749e-05 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:839 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.419674+0000", 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.53772980999999997, 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024180999999999999, 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 839 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419674+0000", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419674+0000", 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419672+0000", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419686+0000", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4904e-05 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419715+0000", 2024-09-21T13:58:28.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8483000000000002e-05 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419731+0000", 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5841999999999998e-05 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419794+0000", 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2731000000000006e-05 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.419920+0000", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000126432 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.420382+0000", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00046252499999999998 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.421624+0000", 2024-09-21T13:58:28.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012410839999999999 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.421998+0000", 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037463500000000001 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.422051+0000", 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3174999999999998e-05 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.422092+0000", 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0821000000000001e-05 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:842 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.426642+0000", 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.530762136, 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024501050000000002, 2024-09-21T13:58:28.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 842 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426642+0000", 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426642+0000", 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426639+0000", 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426656+0000", 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7473e-05 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426695+0000", 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8556999999999997e-05 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426719+0000", 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3745999999999999e-05 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426856+0000", 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137424 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.426968+0000", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112253 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.427379+0000", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00041043699999999999 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.428336+0000", 2024-09-21T13:58:28.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00095753799999999997 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.428994+0000", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065820099999999997 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.429048+0000", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3108e-05 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.429092+0000", 2024-09-21T13:58:28.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4333999999999999e-05 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:859 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.466111+0000", 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.49129260600000002, 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024218540000000002, 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:28.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 859 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466111+0000", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466111+0000", 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:28.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466110+0000", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466116+0000", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466131+0000", 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4741e-05 2024-09-21T13:58:28.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466139+0000", 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7470000000000005e-06 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466181+0000", 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2595999999999997e-05 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:28.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466304+0000", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012294300000000001 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466568+0000", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000264181 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468356+0000", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017875689999999999 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:28.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468416+0000", 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9960999999999997e-05 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468478+0000", 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2274999999999996e-05 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468533+0000", 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4968e-05 2024-09-21T13:58:28.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:860 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.466266+0000", 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.49113769699999998, 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027075049999999998, 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.000 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 860 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466266+0000", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466266+0000", 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466265+0000", 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466274+0000", 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466285+0000", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0735e-05 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466291+0000", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0739999999999998e-06 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466856+0000", 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056525 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466900+0000", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4218000000000003e-05 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.467128+0000", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000227801 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468363+0000", 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001234766 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468887+0000", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052424100000000005 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468924+0000", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7299000000000003e-05 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468974+0000", 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9552999999999998e-05 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:861 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.466398+0000", 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.49100597099999999, 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042429199999999999, 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 861 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466398+0000", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466398+0000", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466397+0000", 2024-09-21T13:58:29.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466403+0000", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0809999999999999e-06 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466413+0000", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0141e-05 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.466421+0000", 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0229999999999992e-06 2024-09-21T13:58:29.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.467459+0000", 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00103761 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.467554+0000", 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5304999999999996e-05 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.467963+0000", 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040900600000000001 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468988+0000", 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001024549 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470578+0000", 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015897420000000001 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470604+0000", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6769000000000001e-05 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470641+0000", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6578000000000001e-05 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:884 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.510775+0000", 2024-09-21T13:58:29.011 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.44662935199999998, 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024424020000000002, 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 884 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510775+0000", 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510775+0000", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510773+0000", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510781+0000", 2024-09-21T13:58:29.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6329999999999996e-06 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510797+0000", 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5744999999999999e-05 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510804+0000", 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4329999999999998e-06 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510859+0000", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5120000000000001e-05 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.510955+0000", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6219999999999997e-05 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.511363+0000", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040790999999999999 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.512486+0000", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011230039999999999 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.513131+0000", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064481900000000003 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.513179+0000", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8124000000000002e-05 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.513217+0000", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7670999999999999e-05 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:887 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.516506+0000", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.44089773999999998, 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003265067, 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 887 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516506+0000", 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516506+0000", 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516506+0000", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516509+0000", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8130000000000002e-06 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516516+0000", 2024-09-21T13:58:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9530000000000002e-06 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.516521+0000", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6330000000000004e-06 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.517446+0000", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00092546800000000004 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.517563+0000", 2024-09-21T13:58:29.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011683 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.517931+0000", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036822899999999997 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.519662+0000", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017302190000000001 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.519692+0000", 2024-09-21T13:58:29.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0124000000000002e-05 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.519737+0000", 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5022999999999999e-05 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.519771+0000", 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4445e-05 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:891 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.526464+0000", 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.430939552, 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025674880000000001, 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 891 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526464+0000", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526464+0000", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526463+0000", 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526472+0000", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2350000000000005e-06 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526489+0000", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6347000000000001e-05 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526499+0000", 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.057e-05 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526551+0000", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1749999999999997e-05 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526627+0000", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6024000000000003e-05 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.526924+0000", 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029690400000000002 2024-09-21T13:58:29.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.528210+0000", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012858419999999999 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.528945+0000", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00073549800000000001 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.528996+0000", 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0992000000000002e-05 2024-09-21T13:58:29.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529032+0000", 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5766999999999998e-05 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:912 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.622497+0000", 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.33490648699999997, 2024-09-21T13:58:29.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035478390000000001, 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 912 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622497+0000", 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622497+0000", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622494+0000", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999962 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622514+0000", 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0797000000000001e-05 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622552+0000", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7178999999999998e-05 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622570+0000", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8139999999999999e-05 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622730+0000", 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015974300000000001 2024-09-21T13:58:29.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.622888+0000", 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000158708 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623476+0000", 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058822200000000001 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.624880+0000", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001404006 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625903+0000", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010225290000000001 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625988+0000", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4919999999999993e-05 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.626045+0000", 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7361999999999997e-05 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:914 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.629609+0000", 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.32779529200000002, 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003357914, 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 914 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629609+0000", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629609+0000", 2024-09-21T13:58:29.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629606+0000", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629619+0000", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2826999999999999e-05 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629646+0000", 2024-09-21T13:58:29.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6743000000000001e-05 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629663+0000", 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6844e-05 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629778+0000", 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115399 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.629927+0000", 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014874800000000001 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630477+0000", 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054967199999999996 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.631764+0000", 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012874469999999999 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.632830+0000", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001065795 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.632912+0000", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1946000000000005e-05 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.632967+0000", 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4722999999999998e-05 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:915 3.0 3:06cb2072:::rbd_data.1185e8851f1.000000000000002f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 197440~58863] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.633129+0000", 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.32427470200000003, 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002894584, 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 915 2024-09-21T13:58:29.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633129+0000", 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633129+0000", 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633127+0000", 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633182+0000", 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4196000000000001e-05 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633206+0000", 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4179999999999999e-05 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633219+0000", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.308e-05 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633298+0000", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8708999999999995e-05 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633506+0000", 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000208459 2024-09-21T13:58:29.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.633726+0000", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021968399999999999 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.635154+0000", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001428566 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.635895+0000", 2024-09-21T13:58:29.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00074041700000000005 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.635969+0000", 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4653000000000005e-05 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636024+0000", 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4429999999999999e-05 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:916 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.636352+0000", 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.32105196400000002, 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030270789999999998, 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 916 2024-09-21T13:58:29.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636352+0000", 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636352+0000", 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636350+0000", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636361+0000", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0497e-05 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636385+0000", 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4626000000000001e-05 2024-09-21T13:58:29.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636398+0000", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2602999999999999e-05 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636466+0000", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8460000000000005e-05 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.636599+0000", 2024-09-21T13:58:29.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132416 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.637179+0000", 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000580695 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.638342+0000", 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011626309999999999 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.639296+0000", 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00095355400000000001 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.639344+0000", 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8149999999999998e-05 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.639379+0000", 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5213999999999999e-05 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:920 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.644238+0000", 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.313165688, 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002734874, 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 920 2024-09-21T13:58:29.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644238+0000", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644238+0000", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644237+0000", 2024-09-21T13:58:29.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644245+0000", 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1869999999999997e-06 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644264+0000", 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9287e-05 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644275+0000", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0416e-05 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644327+0000", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2301e-05 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644417+0000", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0037000000000005e-05 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.644788+0000", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037032100000000001 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.645771+0000", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00098364599999999991 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.646891+0000", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001119472 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.646937+0000", 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6289999999999999e-05 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.646973+0000", 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6154e-05 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:922 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.057 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.669680+0000", 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.28772401600000003, 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003366693, 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 922 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669680+0000", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669680+0000", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669677+0000", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669698+0000", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0863e-05 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669731+0000", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3571000000000001e-05 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669752+0000", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0944000000000001e-05 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669802+0000", 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9320000000000002e-05 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.669887+0000", 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5116000000000003e-05 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670124+0000", 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023698600000000001 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.671117+0000", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0009933819999999999 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672976+0000", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001858639 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673016+0000", 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0747000000000001e-05 2024-09-21T13:58:29.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673047+0000", 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0181000000000001e-05 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:926 3.8 e29/23 3:12eebb35:::rbd_data.1185e8851f1.000000000000004c:head v 29'5, mlcod=29'3)", 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.673911+0000", 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.28349263000000002, 2024-09-21T13:58:29.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031152689999999999, 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673911+0000", 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673911+0000", 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673910+0000", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673919+0000", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673935+0000", 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6164999999999999e-05 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673944+0000", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.789e-06 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.673996+0000", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2692000000000003e-05 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.674023+0000", 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6857000000000001e-05 2024-09-21T13:58:29.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.676931+0000", 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029073340000000001 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.677027+0000", 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6002999999999995e-05 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:932 3.4 3:20b70209:::rbd_object_map.1185e8851f1:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.682096+0000", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.27530775000000002, 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00435564, 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 932 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:29.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682096+0000", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682096+0000", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682095+0000", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682101+0000", 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6620000000000002e-06 2024-09-21T13:58:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682112+0000", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0997e-05 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682120+0000", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0900000000000005e-06 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682573+0000", 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045320000000000001 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682665+0000", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1595999999999995e-05 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.682960+0000", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029512599999999999 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.685157+0000", 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021967169999999999 2024-09-21T13:58:29.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.686402+0000", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012453900000000001 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.686432+0000", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9663999999999999e-05 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.686452+0000", 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9959999999999999e-05 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:29.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:29.073 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:29.074 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.074 INFO:teuthology.orchestra.run.smithi079.stdout:406 read 0x37a3269 thru 0x37aca90 (0x9828 bytes) 2024-09-21T13:58:29.074 INFO:teuthology.orchestra.run.smithi079.stdout:407 write 0x27e5fc0 thru 0x27eb543 (0x5584 bytes) 2024-09-21T13:58:29.074 INFO:teuthology.orchestra.run.smithi079.stdout:408 writesame 0x961b9dd thru 0x962ae01 data_size 0x1(0xf425 bytes) 2024-09-21T13:58:29.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:29.076 INFO:teuthology.orchestra.run.smithi079.stdout:409 write 0x193cf9c thru 0x1947d59 (0xadbe bytes) 2024-09-21T13:58:29.076 INFO:teuthology.orchestra.run.smithi079.stdout:410 read 0x73a08e thru 0x7485f8 (0xe56b bytes) 2024-09-21T13:58:29.076 INFO:teuthology.orchestra.run.smithi079.stdout:412 trunc from 0xc5c69da to 0x81dc4d0 2024-09-21T13:58:29.076 INFO:teuthology.orchestra.run.smithi079.stdout:413 read 0x76832a1 thru 0x768aa13 (0x7773 bytes) 2024-09-21T13:58:29.077 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:29.072+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:29.078 INFO:teuthology.orchestra.run.smithi079.stdout:414 trunc from 0x81dc4d0 to 0xa42ad97 2024-09-21T13:58:29.094 INFO:teuthology.orchestra.run.smithi079.stdout:415 read 0x377522c thru 0x3775317 (0xec bytes) 2024-09-21T13:58:29.094 INFO:teuthology.orchestra.run.smithi079.stdout:416 punch from 0x2dd719c to 0x2de5cd7, (0xeb3b bytes) 2024-09-21T13:58:29.095 INFO:teuthology.orchestra.run.smithi079.stdout:417 writesame 0x98416c1 thru 0x98458dc data_size 0x2(0x421c bytes) 2024-09-21T13:58:29.118 INFO:teuthology.orchestra.run.smithi079.stdout:418 trunc from 0xa42ad97 to 0x4b34a13 2024-09-21T13:58:29.143 INFO:teuthology.orchestra.run.smithi079.stdout:419 trunc from 0x4b34a13 to 0x5054d1f 2024-09-21T13:58:29.154 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.154 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.154 INFO:teuthology.orchestra.run.smithi079.stdout:422 writesame 0xe5165b thru 0xe5bad8 data_size 0x5(0xa47e bytes) 2024-09-21T13:58:29.171 INFO:teuthology.orchestra.run.smithi079.stdout:423 punch from 0x1a56e3e to 0x1a6187e, (0xaa40 bytes) 2024-09-21T13:58:29.175 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:29.175+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:29.185 INFO:teuthology.orchestra.run.smithi079.stdout:425 trunc from 0x5054d1f to 0xb4f6f6a 2024-09-21T13:58:29.198 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:58:29.207 INFO:teuthology.orchestra.run.smithi079.stdout:427 punch from 0x953995b to 0x9545ad6, (0xc17b bytes) 2024-09-21T13:58:29.207 INFO:teuthology.orchestra.run.smithi079.stdout:428 read 0x130d891 thru 0x1318d31 (0xb4a1 bytes) 2024-09-21T13:58:29.210 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.211 INFO:teuthology.orchestra.run.smithi079.stdout:431 read 0x88b115c thru 0x88c0584 (0xf429 bytes) 2024-09-21T13:58:29.211 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.221 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:29.222 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:29.222 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:29.223 INFO:teuthology.orchestra.run.smithi079.stdout:433 trunc from 0xb4f6f6a to 0x4613121 2024-09-21T13:58:29.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:29.250 INFO:teuthology.orchestra.run.smithi079.stdout:435 writesame 0x18340f6 thru 0x183dc15 data_size 0x49(0x9b20 bytes) 2024-09-21T13:58:29.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:29.279 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:29.272+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:29.289 INFO:teuthology.orchestra.run.smithi079.stdout:436 writesame 0xb33154c thru 0xb33b82f data_size 0x8b(0xa2e4 bytes) 2024-09-21T13:58:29.302 INFO:teuthology.orchestra.run.smithi079.stdout:437 trunc from 0xb33b830 to 0x562c4cd 2024-09-21T13:58:29.338 INFO:teuthology.orchestra.run.smithi079.stdout:440 write 0xa73729f thru 0xa742f3e (0xbca0 bytes) 2024-09-21T13:58:29.345 INFO:teuthology.orchestra.run.smithi079.stdout:441 punch from 0x38a5438 to 0x38af9e2, (0xa5aa bytes) 2024-09-21T13:58:29.345 INFO:teuthology.orchestra.run.smithi079.stdout:443 read 0x6f2c91f thru 0x6f37a6e (0xb150 bytes) 2024-09-21T13:58:29.345 INFO:teuthology.orchestra.run.smithi079.stdout:444 write 0x7c664d1 thru 0x7c668c6 (0x3f6 bytes) 2024-09-21T13:58:29.351 INFO:teuthology.orchestra.run.smithi079.stdout:446 read 0x2ae2ff7 thru 0x2ae7ccb (0x4cd5 bytes) 2024-09-21T13:58:29.352 INFO:teuthology.orchestra.run.smithi079.stdout:447 trunc from 0xa742f3f to 0x9a206d4 2024-09-21T13:58:29.373 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:29.374 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:29.374 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:29.374 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:29.374 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:29.377 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:29.376+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:29.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:29.395 INFO:teuthology.orchestra.run.smithi079.stdout:448 writesame 0xd3e8aab thru 0xd3ea547 data_size 0x3(0x1a9d bytes) 2024-09-21T13:58:29.396 INFO:teuthology.orchestra.run.smithi079.stdout:449 write 0xae870f6 thru 0xae89a88 (0x2993 bytes) 2024-09-21T13:58:29.402 INFO:teuthology.orchestra.run.smithi079.stdout:452 trunc from 0xd3ea548 to 0xc968a60 2024-09-21T13:58:29.414 INFO:teuthology.orchestra.run.smithi079.stdout:454 writesame 0xb927601 thru 0xb935871 data_size 0x71(0xe271 bytes) 2024-09-21T13:58:29.419 INFO:teuthology.orchestra.run.smithi079.stdout:455 write 0x45614f7 thru 0x4565e9d (0x49a7 bytes) 2024-09-21T13:58:29.422 INFO:teuthology.orchestra.run.smithi079.stdout:458 write 0x2203468 thru 0x220542c (0x1fc5 bytes) 2024-09-21T13:58:29.439 INFO:teuthology.orchestra.run.smithi079.stdout:461 trunc from 0xc968a60 to 0x43f268f 2024-09-21T13:58:29.442 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:29.443 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:29.460 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:29.461 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:29.468 INFO:teuthology.orchestra.run.smithi079.stdout:463 write 0x46da9fd thru 0x46e28b4 (0x7eb8 bytes) 2024-09-21T13:58:29.474 INFO:teuthology.orchestra.run.smithi079.stdout:464 write 0x3721c42 thru 0x372f800 (0xdbbf bytes) 2024-09-21T13:58:29.477 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:29.475+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:29.478 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:29.478 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:29.481 INFO:teuthology.orchestra.run.smithi079.stdout:467 trunc from 0x46e28b5 to 0x1b970bb 2024-09-21T13:58:29.498 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:29.498 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:29.508 INFO:teuthology.orchestra.run.smithi079.stdout:468 read 0x1a772f8 thru 0x1a8729f (0xffa8 bytes) 2024-09-21T13:58:29.520 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:29.520 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:29.524 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:29.524 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:29.527 INFO:teuthology.orchestra.run.smithi079.stdout:470 write 0x73c1528 thru 0x73cce5a (0xb933 bytes) 2024-09-21T13:58:29.538 INFO:teuthology.orchestra.run.smithi079.stdout:471 trunc from 0x73cce5b to 0xb07ba34 2024-09-21T13:58:29.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:29.542 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:29.542 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:29.549 INFO:teuthology.orchestra.run.smithi079.stdout:473 write 0x56603f7 thru 0x566d8de (0xd4e8 bytes) 2024-09-21T13:58:29.554 INFO:teuthology.orchestra.run.smithi079.stdout:474 read 0x9c10051 thru 0x9c11b65 (0x1b15 bytes) 2024-09-21T13:58:29.554 INFO:teuthology.orchestra.run.smithi079.stdout:475 punch from 0x83682e2 to 0x83762c4, (0xdfe2 bytes) 2024-09-21T13:58:29.554 INFO:teuthology.orchestra.run.smithi079.stdout:478 read 0xb481ec thru 0xb48f12 (0xd27 bytes) 2024-09-21T13:58:29.554 INFO:teuthology.orchestra.run.smithi079.stdout:479 read 0x9565b6 thru 0x95c86e (0x62b9 bytes) 2024-09-21T13:58:29.555 INFO:teuthology.orchestra.run.smithi079.stdout:480 write 0x2631316 thru 0x263694e (0x5639 bytes) 2024-09-21T13:58:29.559 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.565 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:29.565 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:29.572 INFO:teuthology.orchestra.run.smithi079.stdout:482 write 0xd01fadd thru 0xd02c240 (0xc764 bytes) 2024-09-21T13:58:29.578 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:29.579+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:29.580 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.580 INFO:teuthology.orchestra.run.smithi079.stdout:484 writesame 0xbae7b43 thru 0xbaeb510 data_size 0x31(0x39ce bytes) 2024-09-21T13:58:29.585 INFO:teuthology.orchestra.run.smithi079.stdout:485 write 0x58e7152 thru 0x58edbfc (0x6aab bytes) 2024-09-21T13:58:29.589 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:29.589 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:488 read 0xbb90d66 thru 0xbb97a95 (0x6d30 bytes) 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:491 punch from 0x99bb1ab to 0x99c7d67, (0xcbbc bytes) 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.590 INFO:teuthology.orchestra.run.smithi079.stdout:494 write 0x6e54820 thru 0x6e638a5 (0xf086 bytes) 2024-09-21T13:58:29.595 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.595 INFO:teuthology.orchestra.run.smithi079.stdout:496 punch from 0x43ab697 to 0x43b7cbc, (0xc625 bytes) 2024-09-21T13:58:29.610 INFO:teuthology.orchestra.run.smithi079.stdout:499 trunc from 0xd02c241 to 0x4e37685 2024-09-21T13:58:29.631 INFO:teuthology.orchestra.run.smithi079.stdout:501 trunc from 0x4e37685 to 0x22f9ed2 2024-09-21T13:58:29.664 INFO:teuthology.orchestra.run.smithi079.stdout:502 write 0x7645afd thru 0x765333c (0xd840 bytes) 2024-09-21T13:58:29.668 INFO:teuthology.orchestra.run.smithi079.stdout:504 read 0xa30cfb thru 0xa341e7 (0x34ed bytes) 2024-09-21T13:58:29.668 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:29.669 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:29.669 INFO:teuthology.orchestra.run.smithi079.stdout:506 read 0x3885a2e thru 0x388d51a (0x7aed bytes) 2024-09-21T13:58:29.681 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:29.679+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:29.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:29.698 INFO:teuthology.orchestra.run.smithi079.stdout:508 write 0xe571911 thru 0xe57adb5 (0x94a5 bytes) 2024-09-21T13:58:29.698 INFO:teuthology.orchestra.run.smithi079.stdout:510 read 0x4549198 thru 0x4550597 (0x7400 bytes) 2024-09-21T13:58:29.698 INFO:teuthology.orchestra.run.smithi079.stdout:512 write 0x9ca6c2a thru 0x9cb1e73 (0xb24a bytes) 2024-09-21T13:58:29.701 INFO:teuthology.orchestra.run.smithi079.stdout:513 punch from 0x83cf266 to 0x83dcfc3, (0xdd5d bytes) 2024-09-21T13:58:29.702 INFO:teuthology.orchestra.run.smithi079.stdout:515 read 0x2640cdc thru 0x2643eb1 (0x31d6 bytes) 2024-09-21T13:58:29.702 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.702 INFO:teuthology.orchestra.run.smithi079.stdout:517 read 0xa3f97a6 thru 0xa4034d2 (0x9d2d bytes) 2024-09-21T13:58:29.702 INFO:teuthology.orchestra.run.smithi079.stdout:518 read 0xcfb9e3 thru 0xd03821 (0x7e3f bytes) 2024-09-21T13:58:29.703 INFO:teuthology.orchestra.run.smithi079.stdout:519 punch from 0x53fa0bd to 0x540433d, (0xa280 bytes) 2024-09-21T13:58:29.703 INFO:teuthology.orchestra.run.smithi079.stdout:520 write 0xbc4218c thru 0xbc424c5 (0x33a bytes) 2024-09-21T13:58:29.709 INFO:teuthology.orchestra.run.smithi079.stdout:521 read 0x1db7885 thru 0x1dc0b28 (0x92a4 bytes) 2024-09-21T13:58:29.709 INFO:teuthology.orchestra.run.smithi079.stdout:522 writesame 0xa3d00a4 thru 0xa3dcb04 data_size 0x1(0xca61 bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:524 read 0x9443eee thru 0x944ec19 (0xad2c bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:525 read 0xbd046b4 thru 0xbd11427 (0xcd74 bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:529 read 0xd3e756e thru 0xd3e90d1 (0x1b64 bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:532 read 0xc7fad0 thru 0xc7fbb6 (0xe7 bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:533 read 0x86a9729 thru 0x86ad3a6 (0x3c7e bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:534 read 0x8add357 thru 0x8ae8ae6 (0xb790 bytes) 2024-09-21T13:58:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:535 clone 2 order 21 su 524288 sc 5 2024-09-21T13:58:29.788 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:29.776+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:29.821 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:29.822 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:29.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:29.888 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:29.880+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:29.965 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:29.965 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:29.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:29.986 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:29.983+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:30.085 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:30.083+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:30.115 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.115 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:30.188 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:30.184+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:30.264 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.265 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:30.326 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:30.324+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:30.332 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone1 from 0xe57adb6 (overlap 0x1b970bb) to 0x18d4bdb 2024-09-21T13:58:30.387 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:30.387+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:30.453 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.454 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:30.486 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-21T13:58:30.513 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:30.512+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:30.588 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:30.587+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:30.594 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.594 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.608 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:30.688 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:30.687+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:30.692 INFO:teuthology.orchestra.run.smithi079.stdout:536 write 0x75490e6 thru 0x7551210 (0x812b bytes) 2024-09-21T13:58:30.704 INFO:teuthology.orchestra.run.smithi079.stdout:537 write 0x92f8a96 thru 0x930567b (0xcbe6 bytes) 2024-09-21T13:58:30.715 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:30.715 INFO:teuthology.orchestra.run.smithi079.stdout:539 write 0x362a1e7 thru 0x3633165 (0x8f7f bytes) 2024-09-21T13:58:30.724 INFO:teuthology.orchestra.run.smithi079.stdout:542 read 0xd081bdd thru 0xd084f0b (0x332f bytes) 2024-09-21T13:58:30.724 INFO:teuthology.orchestra.run.smithi079.stdout:543 read 0xcf9c714 thru 0xcfa62ae (0x9b9b bytes) 2024-09-21T13:58:30.725 INFO:teuthology.orchestra.run.smithi079.stdout:546 write 0x771a06b thru 0x771c00f (0x1fa5 bytes) 2024-09-21T13:58:30.731 INFO:teuthology.orchestra.run.smithi079.stdout:547 writesame 0xd2438b5 thru 0xd24a835 data_size 0x21(0x6f81 bytes) 2024-09-21T13:58:30.741 INFO:teuthology.orchestra.run.smithi079.stdout:548 write 0x22ac2e1 thru 0x22b713a (0xae5a bytes) 2024-09-21T13:58:30.749 INFO:teuthology.orchestra.run.smithi079.stdout:549 writesame 0x9e2f07 thru 0x9ee860 data_size 0x1a(0xb95a bytes) 2024-09-21T13:58:30.768 INFO:teuthology.orchestra.run.smithi079.stdout:552 read 0xd4791a7 thru 0xd47db46 (0x49a0 bytes) 2024-09-21T13:58:30.768 INFO:teuthology.orchestra.run.smithi079.stdout:553 write 0x8da0a3b thru 0x8da150d (0xad3 bytes) 2024-09-21T13:58:30.775 INFO:teuthology.orchestra.run.smithi079.stdout:555 trunc from 0xe57adb6 to 0xd074ffc 2024-09-21T13:58:30.776 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.776 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.789 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:30.788+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:30.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:30.808 INFO:teuthology.orchestra.run.smithi079.stdout:556 read 0x74e664c thru 0x74f5175 (0xeb2a bytes) 2024-09-21T13:58:30.809 INFO:teuthology.orchestra.run.smithi079.stdout:557 write 0xa22e246 thru 0xa23296a (0x4725 bytes) 2024-09-21T13:58:30.818 INFO:teuthology.orchestra.run.smithi079.stdout:558 write 0x5aa7dd7 thru 0x5aaec13 (0x6e3d bytes) 2024-09-21T13:58:30.825 INFO:teuthology.orchestra.run.smithi079.stdout:559 writesame 0x8c905d3 thru 0x8c95f25 data_size 0x1(0x5953 bytes) 2024-09-21T13:58:30.854 INFO:teuthology.orchestra.run.smithi079.stdout:562 write 0xd7ba0ff thru 0xd7beb97 (0x4a99 bytes) 2024-09-21T13:58:30.873 INFO:teuthology.orchestra.run.smithi079.stdout:563 trunc from 0xd7beb98 to 0x8e807c5 2024-09-21T13:58:30.889 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:30.888+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:30.908 INFO:teuthology.orchestra.run.smithi079.stdout:564 trunc from 0x8e807c5 to 0xbe71a65 2024-09-21T13:58:30.919 INFO:teuthology.orchestra.run.smithi079.stdout:565 read 0x6793383 thru 0x6797e37 (0x4ab5 bytes) 2024-09-21T13:58:30.919 INFO:teuthology.orchestra.run.smithi079.stdout:567 clone 3 order 18 su 32768 sc 6 2024-09-21T13:58:30.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:30.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:30.945 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-21T13:58:30.945 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T13:58:30.945 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T13:58:30.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-21T13:58:30.956 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:30.957 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:30.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:30.991 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:30.991+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:31.063 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:31.064 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T13:58:31.064 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:31.091 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:31.088+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:31.134 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.135 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.148 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:31.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:31.191+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:31.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:58:31.293 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:31.291+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:31.317 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.317 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.334 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:31.342 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone2 from 0xbe71a65 (overlap 0x8e807c5) to 0x55804a9 2024-09-21T13:58:31.394 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:31.392+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:31.466 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.466 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:31.516 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-21T13:58:31.525 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:31.524+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:31.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:31.595+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:31.596 INFO:teuthology.orchestra.run.smithi079.stdout:568 write 0x12d43eb thru 0x12e1ed9 (0xdaef bytes) 2024-09-21T13:58:31.615 INFO:teuthology.orchestra.run.smithi079.stdout:570 punch from 0x73cc554 to 0x73dbfde, (0xfa8a bytes) 2024-09-21T13:58:31.616 INFO:teuthology.orchestra.run.smithi079.stdout:571 trunc from 0xbe71a65 to 0xadba4ee 2024-09-21T13:58:31.621 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:31.644 INFO:teuthology.orchestra.run.smithi079.stdout:572 trunc from 0xadba4ee to 0x80e7844 2024-09-21T13:58:31.656 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.657 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:31.673 INFO:teuthology.orchestra.run.smithi079.stdout:573 trunc from 0x80e7844 to 0x92c22d8 2024-09-21T13:58:31.681 INFO:teuthology.orchestra.run.smithi079.stdout:574 punch from 0x270664c to 0x271327c, (0xcc30 bytes) 2024-09-21T13:58:31.681 INFO:teuthology.orchestra.run.smithi079.stdout:576 punch from 0x2546e5f to 0x25516e0, (0xa881 bytes) 2024-09-21T13:58:31.681 INFO:teuthology.orchestra.run.smithi079.stdout:578 punch from 0x58d911c to 0x58df6f4, (0x65d8 bytes) 2024-09-21T13:58:31.681 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.681 INFO:teuthology.orchestra.run.smithi079.stdout:580 writesame 0x10e0bec thru 0x10ebb1b data_size 0x8(0xaf30 bytes) 2024-09-21T13:58:31.696 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:31.695+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:31.699 INFO:teuthology.orchestra.run.smithi079.stdout:582 write 0x9deb4c8 thru 0x9dfb2c2 (0xfdfb bytes) 2024-09-21T13:58:31.711 INFO:teuthology.orchestra.run.smithi079.stdout:589 write 0x8c1144c thru 0x8c183b8 (0x6f6d bytes) 2024-09-21T13:58:31.718 INFO:teuthology.orchestra.run.smithi079.stdout:590 write 0x5296570 thru 0x52a5fcc (0xfa5d bytes) 2024-09-21T13:58:31.742 INFO:teuthology.orchestra.run.smithi079.stdout:591 write 0xdacde06 thru 0xdad5dd5 (0x7fd0 bytes) 2024-09-21T13:58:31.749 INFO:teuthology.orchestra.run.smithi079.stdout:592 punch from 0x4efdc2c to 0x4f05e7f, (0x8253 bytes) 2024-09-21T13:58:31.750 INFO:teuthology.orchestra.run.smithi079.stdout:594 punch from 0xa0cc209 to 0xa0d2982, (0x6779 bytes) 2024-09-21T13:58:31.750 INFO:teuthology.orchestra.run.smithi079.stdout:595 writesame 0xb2beeda thru 0xb2c6707 data_size 0x1(0x782e bytes) 2024-09-21T13:58:31.769 INFO:teuthology.orchestra.run.smithi079.stdout:597 punch from 0x82b4f00 to 0x82beb43, (0x9c43 bytes) 2024-09-21T13:58:31.769 INFO:teuthology.orchestra.run.smithi079.stdout:598 read 0x1e3477a thru 0x1e4351d (0xeda4 bytes) 2024-09-21T13:58:31.769 INFO:teuthology.orchestra.run.smithi079.stdout:599 punch from 0x24b5260 to 0x24bf8e5, (0xa685 bytes) 2024-09-21T13:58:31.769 INFO:teuthology.orchestra.run.smithi079.stdout:600 punch from 0x5137a6f to 0x51395f7, (0x1b88 bytes) 2024-09-21T13:58:31.769 INFO:teuthology.orchestra.run.smithi079.stdout:601 writesame 0x5a8b6bb thru 0x5a8fb41 data_size 0x1(0x4487 bytes) 2024-09-21T13:58:31.780 INFO:teuthology.orchestra.run.smithi079.stdout:602 writesame 0x9a1756d thru 0x9a1c988 data_size 0xe(0x541c bytes) 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:604 read 0xa9a595d thru 0xa9ad11b (0x77bf bytes) 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:605 read 0x82d696e thru 0x82dadb3 (0x4446 bytes) 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:609 read 0x7f1a244 thru 0x7f1e1fd (0x3fba bytes) 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:610 punch from 0x15b7c1a to 0x15c22d8, (0xa6be bytes) 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:613 write 0x149ce3 thru 0x14c34e (0x266c bytes) 2024-09-21T13:58:31.787 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:31.789 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.796 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.796 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.796 INFO:teuthology.orchestra.run.smithi079.stdout:617 trunc from 0xdad5dd6 to 0x9287b44 2024-09-21T13:58:31.797 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:31.796+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:31.804 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:31.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:31.814 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.822 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:31.822 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:31.826 INFO:teuthology.orchestra.run.smithi079.stdout:622 write 0xaf99226 thru 0xafa60fe (0xced9 bytes) 2024-09-21T13:58:31.832 INFO:teuthology.orchestra.run.smithi079.stdout:624 write 0x53d617c thru 0x53d97cb (0x3650 bytes) 2024-09-21T13:58:31.838 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.839 INFO:teuthology.orchestra.run.smithi079.stdout:627 read 0x5f22b14 thru 0x5f2c746 (0x9c33 bytes) 2024-09-21T13:58:31.843 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:31.843 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:31.848 INFO:teuthology.orchestra.run.smithi079.stdout:628 write 0xc3f35a0 thru 0xc3f9890 (0x62f1 bytes) 2024-09-21T13:58:31.865 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:31.865 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:31.866 INFO:teuthology.orchestra.run.smithi079.stdout:629 trunc from 0xc3f9891 to 0x25b93c8 2024-09-21T13:58:31.896 INFO:teuthology.orchestra.run.smithi079.stdout:630 trunc from 0x25b93c8 to 0x32e87fa 2024-09-21T13:58:31.898 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:31.896+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:31.903 INFO:teuthology.orchestra.run.smithi079.stdout:631 read 0x1e78abe thru 0x1e862a3 (0xd7e6 bytes) 2024-09-21T13:58:31.918 INFO:teuthology.orchestra.run.smithi079.stdout:632 write 0x78bfd9f thru 0x78c2075 (0x22d7 bytes) 2024-09-21T13:58:31.923 INFO:teuthology.orchestra.run.smithi079.stdout:633 write 0x4cfb6e3 thru 0x4cfdb03 (0x2421 bytes) 2024-09-21T13:58:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.927 INFO:teuthology.orchestra.run.smithi079.stdout:639 write 0x18f63e3 thru 0x18fb721 (0x533f bytes) 2024-09-21T13:58:31.933 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:31.953 INFO:teuthology.orchestra.run.smithi079.stdout:641 write 0xeb5d1ad thru 0xeb646e7 (0x753b bytes) 2024-09-21T13:58:31.973 INFO:teuthology.orchestra.run.smithi079.stdout:642 trunc from 0xeb646e8 to 0x762815f 2024-09-21T13:58:31.985 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:31.985 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:31.998 INFO:teuthology.orchestra.run.smithi079.stdout:644 clone 4 order 22 su 131072 sc 11 2024-09-21T13:58:31.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:31.999+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:32.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:32.086 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:32.086 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:32.100 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:32.096+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:32.111 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:32.111 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:32.124 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:32.124 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:32.124 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:32.124 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:32.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:32.139 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:32.139 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:32.201 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:32.200+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:32.210 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:58:32.272 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:32.273 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:32.273 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:32.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:32.334 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:32.335+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:32.353 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone3 intact 2024-09-21T13:58:32.403 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:32.400+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:32.414 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:32.414 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:32.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:32.414 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.450764596999999, 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051845399999999996, 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964059+0000", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964058+0000", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964141+0000", 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3331999999999994e-05 2024-09-21T13:58:32.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964162+0000", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1056999999999998e-05 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964190+0000", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8243e-05 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964261+0000", 2024-09-21T13:58:32.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0458999999999997e-05 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.964293+0000", 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2270000000000001e-05 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969166+0000", 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048727919999999999 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.969243+0000", 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7516999999999997e-05 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.448495837999999, 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050517169999999998, 2024-09-21T13:58:32.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966327+0000", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966326+0000", 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966337+0000", 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0256e-05 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966358+0000", 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1063000000000001e-05 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966370+0000", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2724e-05 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966469+0000", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8921999999999999e-05 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.966508+0000", 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.888e-05 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971275+0000", 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047667059999999999 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:06.971379+0000", 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104286 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.423 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.388427646, 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053209900000000003, 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026396+0000", 2024-09-21T13:58:32.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026394+0000", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026419+0000", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5256e-05 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026443+0000", 2024-09-21T13:58:32.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3842999999999999e-05 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.026455+0000", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2207e-05 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027293+0000", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00083795300000000001 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.027352+0000", 2024-09-21T13:58:32.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.91e-05 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031648+0000", 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042961600000000003 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.031717+0000", 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8167e-05 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:132 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'90, mlcod=16'85)", 2024-09-21T13:58:32.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.693911862, 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056392600000000001, 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720911+0000", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720910+0000", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720925+0000", 2024-09-21T13:58:32.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4773000000000001e-05 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720947+0000", 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1953000000000001e-05 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.720961+0000", 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4446e-05 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722303+0000", 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013414729999999999 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722362+0000", 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9363000000000001e-05 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726455+0000", 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040928379999999997 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726551+0000", 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5649999999999994e-05 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:133 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'91, mlcod=16'85)", 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.693296286999999, 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075400450000000004, 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721527+0000", 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721526+0000", 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721538+0000", 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-05 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721567+0000", 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9635999999999999e-05 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.721582+0000", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.486e-05 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723342+0000", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017600960000000001 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723402+0000", 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9688999999999997e-05 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.728990+0000", 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055877940000000001 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729067+0000", 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7236000000000004e-05 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'85)", 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.692772140999999, 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070881590000000001, 2024-09-21T13:58:32.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722051+0000", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722050+0000", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722126+0000", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5774999999999999e-05 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722177+0000", 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1583999999999999e-05 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722196+0000", 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8972999999999999e-05 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724546+0000", 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002350071 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724582+0000", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5553000000000003e-05 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729077+0000", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044949250000000003 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729139+0000", 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2473999999999999e-05 2024-09-21T13:58:32.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'85)", 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.691977012999999, 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079821179999999999, 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722846+0000", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722844+0000", 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722858+0000", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3606e-05 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722886+0000", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8116e-05 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.722899+0000", 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2802999999999999e-05 2024-09-21T13:58:32.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725603+0000", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002704166 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725660+0000", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6709999999999997e-05 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730755+0000", 2024-09-21T13:58:32.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050949139999999999 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730828+0000", 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3592999999999998e-05 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:136 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'94, mlcod=16'85)", 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.691461601, 2024-09-21T13:58:32.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075270889999999998, 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723362+0000", 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723361+0000", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723371+0000", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0209e-05 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723387+0000", 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.579e-05 2024-09-21T13:58:32.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723400+0000", 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3113e-05 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726660+0000", 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003260092 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726721+0000", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1116000000000002e-05 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730837+0000", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041155280000000002 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730889+0000", 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2227e-05 2024-09-21T13:58:32.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:137 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'95, mlcod=16'85)", 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.690829482000002, 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092100250000000002, 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723994+0000", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.723993+0000", 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724109+0000", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115919 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724128+0000", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9497e-05 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724142+0000", 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3596e-05 2024-09-21T13:58:32.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727440+0000", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003298685 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.727493+0000", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2973000000000003e-05 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733130+0000", 2024-09-21T13:58:32.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056365670000000003 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733204+0000", 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3812000000000004e-05 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:138 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'85)", 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.690086075, 2024-09-21T13:58:32.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085262879999999999, 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724737+0000", 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724736+0000", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724744+0000", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0929999999999997e-06 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724763+0000", 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000001e-05 2024-09-21T13:58:32.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.724848+0000", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4746000000000005e-05 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729217+0000", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043694019999999997 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729253+0000", 2024-09-21T13:58:32.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6096999999999997e-05 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733208+0000", 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003954323 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733263+0000", 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5779999999999998e-05 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'85)", 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.689636895, 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081432770000000008, 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725186+0000", 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725195+0000", 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0899999999999994e-06 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725211+0000", 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6863000000000001e-05 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.725221+0000", 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0170000000000002e-06 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729879+0000", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046583570000000001 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.729934+0000", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5276999999999999e-05 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733270+0000", 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033358509999999999 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733330+0000", 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9639000000000003e-05 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'88)", 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.688818992000002, 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073847440000000004, 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726004+0000", 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726002+0000", 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726122+0000", 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119323 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726208+0000", 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6458999999999993e-05 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726227+0000", 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8666999999999999e-05 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.730976+0000", 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004749573 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.731011+0000", 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5126999999999998e-05 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733333+0000", 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023211389999999998 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733389+0000", 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6465999999999998e-05 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'88)", 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.688300546000001, 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073917740000000003, 2024-09-21T13:58:32.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726523+0000", 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726521+0000", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726535+0000", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3543000000000001e-05 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726557+0000", 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2160000000000001e-05 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.726570+0000", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.287e-05 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732292+0000", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057226129999999997 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.732349+0000", 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6375999999999997e-05 2024-09-21T13:58:32.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733845+0000", 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014963680000000001 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:07.733914+0000", 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9419999999999996e-05 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:156 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'110, mlcod=16'105)", 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.973871255999999, 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061283630000000004, 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440952+0000", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440951+0000", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440957+0000", 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2939999999999996e-06 2024-09-21T13:58:32.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440966+0000", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3689999999999996e-06 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.440973+0000", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5339999999999996e-06 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441011+0000", 2024-09-21T13:58:32.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8824e-05 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.441028+0000", 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6407999999999999e-05 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.446998+0000", 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059700179999999997 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.447080+0000", 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2496000000000004e-05 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4195.0:158 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'112, mlcod=17'107)", 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.971263769, 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061998649999999997, 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443559+0000", 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:32.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443660+0000", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101098 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443669+0000", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9879999999999993e-06 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443674+0000", 2024-09-21T13:58:32.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443708+0000", 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4474999999999998e-05 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.443723+0000", 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5012e-05 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449688+0000", 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059649200000000003 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:08.449759+0000", 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1218999999999997e-05 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7434191299999995, 2024-09-21T13:58:32.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052270329999999999, 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671404+0000", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671402+0000", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671416+0000", 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4483e-05 2024-09-21T13:58:32.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671442+0000", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.588e-05 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671457+0000", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4837999999999999e-05 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671533+0000", 2024-09-21T13:58:32.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5984999999999998e-05 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.671540+0000", 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6839999999999999e-06 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674569+0000", 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003029402 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674725+0000", 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015601699999999999 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.674963+0000", 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000237801 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676421+0000", 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001457928 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676520+0000", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9550999999999996e-05 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676590+0000", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9983999999999999e-05 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:23.676631+0000", 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0904e-05 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.489 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:690 3.12 3:4eae972e:::rbd_data.1185f0a8fe85.0000000000000016:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2622218050000003, 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008593046, 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:32.490 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 690 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152601+0000", 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152606+0000", 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9660000000000001e-06 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152618+0000", 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1949e-05 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152628+0000", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9809999999999998e-06 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152668+0000", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9669000000000003e-05 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.152719+0000", 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1282999999999997e-05 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.154004+0000", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012846909999999999 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161124+0000", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007119495 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161135+0000", 2024-09-21T13:58:32.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1147e-05 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161168+0000", 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3556000000000002e-05 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:27.161194+0000", 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6242999999999999e-05 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:845 3.12 3:4c6dab2e:::rbd_data.1185e8851f1.000000000000005b:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1214839~59234] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.434847+0000", 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.979976331, 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005389189, 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 845 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434847+0000", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434847+0000", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434845+0000", 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434869+0000", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4426999999999998e-05 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434887+0000", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7657000000000001e-05 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434895+0000", 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7640000000000005e-06 2024-09-21T13:58:32.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434962+0000", 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6938000000000002e-05 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op must wait for map", 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.434969+0000", 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0199999999999997e-06 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.437456+0000", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002486959 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.437562+0000", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106735 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.437662+0000", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9777000000000004e-05 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:32.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.438790+0000", 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011277920000000001 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.440164+0000", 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013742299999999999 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.440198+0000", 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4161e-05 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.440236+0000", 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7809999999999999e-05 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2065 3.1b 3:dd813135:::rbd_data.11854cc47015.00000000000002cc:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:31.803376+0000", 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.61144763099999999, 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055052850000000004, 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2065 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803376+0000", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803376+0000", 2024-09-21T13:58:32.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803375+0000", 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803380+0000", 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803389+0000", 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1919999999999994e-06 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803395+0000", 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9120000000000003e-06 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803438+0000", 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3421999999999999e-05 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803490+0000", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2284999999999998e-05 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.803549+0000", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8454e-05 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.804006+0000", 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045744699999999999 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.808831+0000", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048243050000000001 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.808860+0000", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9516999999999999e-05 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.808881+0000", 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0834000000000001e-05 2024-09-21T13:58:32.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2243 3.6 3:65639334:::rbd_object_map.11854cc47015:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:31.985126+0000", 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.42969709099999998, 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053627639999999999, 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:32.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2243 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985126+0000", 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985126+0000", 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985124+0000", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985134+0000", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6369999999999994e-06 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985155+0000", 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1229999999999998e-05 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985167+0000", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2153e-05 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985218+0000", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0606999999999998e-05 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985283+0000", 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5211999999999998e-05 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.985553+0000", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026933799999999999 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.987573+0000", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020199699999999998 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.990247+0000", 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026740370000000002 2024-09-21T13:58:32.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.990391+0000", 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014415200000000001 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:31.990489+0000", 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8195000000000004e-05 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:32.513 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:32.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:32.515 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:32.512+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:32.551 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-21T13:58:32.616 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:32.612+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:32.684 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:32.684 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:32.684 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:32.684 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:32.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:32.717 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:32.716+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:32.751 INFO:teuthology.orchestra.run.smithi079.stdout:645 punch from 0x4b0effb to 0x4b18a4e, (0x9a53 bytes) 2024-09-21T13:58:32.756 INFO:teuthology.orchestra.run.smithi079.stdout:646 read 0x68b83e3 thru 0x68bf741 (0x735f bytes) 2024-09-21T13:58:32.759 INFO:teuthology.orchestra.run.smithi079.stdout:647 trunc from 0x762815f to 0x5ed5b6a 2024-09-21T13:58:32.806 INFO:teuthology.orchestra.run.smithi079.stdout:648 write 0xd0ec4c3 thru 0xd0fb7ee (0xf32c bytes) 2024-09-21T13:58:32.817 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:32.816+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:32.823 INFO:teuthology.orchestra.run.smithi079.stdout:650 trunc from 0xd0fb7ef to 0x5b3f21e 2024-09-21T13:58:32.851 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:32.851 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:32.852 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:32.852 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:32.852 INFO:teuthology.orchestra.run.smithi079.stdout:654 punch from 0xb907cf to 0xb98754, (0x7f85 bytes) 2024-09-21T13:58:32.859 INFO:teuthology.orchestra.run.smithi079.stdout:658 trunc from 0x5b3f21e to 0x121129f 2024-09-21T13:58:32.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:32.922 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:32.923+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:32.976 INFO:teuthology.orchestra.run.smithi079.stdout:659 write 0x88acd3 thru 0x893caa (0x8fd8 bytes) 2024-09-21T13:58:32.978 INFO:teuthology.orchestra.run.smithi079.stdout:660 read 0xc2b80e thru 0xc373f3 (0xbbe6 bytes) 2024-09-21T13:58:32.979 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:32.979 INFO:teuthology.orchestra.run.smithi079.stdout:662 punch from 0xf7f1ec to 0xf83ff7, (0x4e0b bytes) 2024-09-21T13:58:32.979 INFO:teuthology.orchestra.run.smithi079.stdout:663 punch from 0x110f311 to 0x1118f49, (0x9c38 bytes) 2024-09-21T13:58:32.979 INFO:teuthology.orchestra.run.smithi079.stdout:664 read 0xc37dd3 thru 0xc47253 (0xf481 bytes) 2024-09-21T13:58:33.006 INFO:teuthology.orchestra.run.smithi079.stdout:665 write 0xe7f12f4 thru 0xe7f4261 (0x2f6e bytes) 2024-09-21T13:58:33.012 INFO:teuthology.orchestra.run.smithi079.stdout:668 writesame 0x2461e96 thru 0x246bc41 data_size 0x2(0x9dac bytes) 2024-09-21T13:58:33.019 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:33.019+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.1893717089999996, 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:33.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:58:33.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0493482690000002, 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:58:33.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:33.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:33.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0210892640000004, 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:58:33.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:58:33.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3299 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3801088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901039+0000", 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.124096421, 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078743619999999993, 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3299 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901039+0000", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901039+0000", 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901038+0000", 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901043+0000", 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4079999999999997e-06 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901064+0000", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0692000000000001e-05 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901075+0000", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0859999999999999e-05 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.908607+0000", 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075324800000000003 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.908749+0000", 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014123599999999999 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.908913+0000", 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016454600000000001 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3300 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3833856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901085+0000", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.124049839, 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079955809999999999, 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3300 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901085+0000", 2024-09-21T13:58:33.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901085+0000", 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901085+0000", 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901118+0000", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3513999999999998e-05 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901133+0000", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.483e-05 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901145+0000", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1652e-05 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.908952+0000", 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078067370000000002 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909009+0000", 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7318999999999998e-05 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909081+0000", 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2193000000000005e-05 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.123980719, 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:58:33.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:58:33.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.12391924999999999, 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.1157485, 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:58:33.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3480 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 262144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910247+0000", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114887985, 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078654889999999998, 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3480 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910247+0000", 2024-09-21T13:58:33.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910247+0000", 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910247+0000", 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910255+0000", 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3329999999999997e-06 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910268+0000", 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2913e-05 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910274+0000", 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8220000000000003e-06 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917994+0000", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077202529999999998 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918045+0000", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.126e-05 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918113+0000", 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7583999999999995e-05 2024-09-21T13:58:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.11485527500000001, 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114797515, 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:58:33.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.075 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114778923, 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:58:33.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:58:33.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114766585, 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114744849, 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.084 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:33.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114721666, 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:58:33.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:58:33.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114701237, 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114686439, 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.11466185499999999, 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:58:33.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.104 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114645159, 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:33.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:33.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.114622922, 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:58:33.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:58:33.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.112 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:33.113 INFO:teuthology.orchestra.run.smithi079.stdout:669 read 0xd4eb845 thru 0xd4f75a7 (0xbd63 bytes) 2024-09-21T13:58:33.113 INFO:teuthology.orchestra.run.smithi079.stdout:670 read 0x51b7c48 thru 0x51bc64f (0x4a08 bytes) 2024-09-21T13:58:33.113 INFO:teuthology.orchestra.run.smithi079.stdout:671 trunc from 0xe7f4262 to 0xd0e1549 2024-09-21T13:58:33.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:672 writesame 0x9d697c6 thru 0x9d7464b data_size 0x59(0xae86 bytes) 2024-09-21T13:58:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:674 punch from 0xa4cc2b6 to 0xa4d7b03, (0xb84d bytes) 2024-09-21T13:58:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:676 punch from 0xba6ae6c to 0xba75fa1, (0xb135 bytes) 2024-09-21T13:58:33.115 INFO:teuthology.orchestra.run.smithi079.stdout:677 writesame 0x29ebcda thru 0x29ed6b8 data_size 0x1(0x19df bytes) 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:678 punch from 0x94ccfa3 to 0x94d84cc, (0xb529 bytes) 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:681 trunc from 0xd0e1549 to 0xd5e94c4 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:682 write 0x6758f9f thru 0x6759d99 (0xdfb bytes) 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:683 punch from 0x63d548a to 0x63d84f7, (0x306d bytes) 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:684 punch from 0x41f6a99 to 0x41f8531, (0x1a98 bytes) 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.116 INFO:teuthology.orchestra.run.smithi079.stdout:686 trunc from 0xd5e94c4 to 0x82aa799 2024-09-21T13:58:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:689 read 0x77cdaca thru 0x77d14d6 (0x3a0d bytes) 2024-09-21T13:58:33.123 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:33.123+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:33.124 INFO:teuthology.orchestra.run.smithi079.stdout:690 write 0x754dbe thru 0x7572ab (0x24ee bytes) 2024-09-21T13:58:33.129 INFO:teuthology.orchestra.run.smithi079.stdout:691 trunc from 0x82aa799 to 0x7ac5a23 2024-09-21T13:58:33.142 INFO:teuthology.orchestra.run.smithi079.stdout:694 read 0x6b7c594 thru 0x6b7ed05 (0x2772 bytes) 2024-09-21T13:58:33.142 INFO:teuthology.orchestra.run.smithi079.stdout:696 punch from 0x38def7c to 0x38e7cf1, (0x8d75 bytes) 2024-09-21T13:58:33.159 INFO:teuthology.orchestra.run.smithi079.stdout:697 write 0xb036ed7 thru 0xb046626 (0xf750 bytes) 2024-09-21T13:58:33.167 INFO:teuthology.orchestra.run.smithi079.stdout:699 write 0x91afead thru 0x91bc91a (0xca6e bytes) 2024-09-21T13:58:33.174 INFO:teuthology.orchestra.run.smithi079.stdout:700 writesame 0x424d4cd thru 0x425ca32 data_size 0x65(0xf566 bytes) 2024-09-21T13:58:33.181 INFO:teuthology.orchestra.run.smithi079.stdout:701 read 0x5777167 thru 0x5781cfd (0xab97 bytes) 2024-09-21T13:58:33.181 INFO:teuthology.orchestra.run.smithi079.stdout:702 write 0x8840f0e thru 0x8843554 (0x2647 bytes) 2024-09-21T13:58:33.188 INFO:teuthology.orchestra.run.smithi079.stdout:703 punch from 0x4603a2 to 0x462005, (0x1c63 bytes) 2024-09-21T13:58:33.189 INFO:teuthology.orchestra.run.smithi079.stdout:704 read 0x5e5263d thru 0x5e5d197 (0xab5b bytes) 2024-09-21T13:58:33.189 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.192 INFO:teuthology.orchestra.run.smithi079.stdout:706 trunc from 0xb046627 to 0xccf6c1c 2024-09-21T13:58:33.202 INFO:teuthology.orchestra.run.smithi079.stdout:707 punch from 0x9a61b53 to 0x9a6da67, (0xbf14 bytes) 2024-09-21T13:58:33.202 INFO:teuthology.orchestra.run.smithi079.stdout:708 read 0x3c757f4 thru 0x3c7e97f (0x918c bytes) 2024-09-21T13:58:33.202 INFO:teuthology.orchestra.run.smithi079.stdout:709 write 0x5d69ad9 thru 0x5d724e3 (0x8a0b bytes) 2024-09-21T13:58:33.208 INFO:teuthology.orchestra.run.smithi079.stdout:711 punch from 0x9abfeda to 0x9ac54b3, (0x55d9 bytes) 2024-09-21T13:58:33.208 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.208 INFO:teuthology.orchestra.run.smithi079.stdout:713 write 0x6656820 thru 0x6661f0e (0xb6ef bytes) 2024-09-21T13:58:33.217 INFO:teuthology.orchestra.run.smithi079.stdout:714 read 0x2f00493 thru 0x2f05d46 (0x58b4 bytes) 2024-09-21T13:58:33.220 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:33.219+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:33.226 INFO:teuthology.orchestra.run.smithi079.stdout:715 write 0xd3ef1c5 thru 0xd3f5cd0 (0x6b0c bytes) 2024-09-21T13:58:33.230 INFO:teuthology.orchestra.run.smithi079.stdout:716 read 0xc1bf83f thru 0xc1bfce6 (0x4a8 bytes) 2024-09-21T13:58:33.230 INFO:teuthology.orchestra.run.smithi079.stdout:719 write 0x7a5eb7c thru 0x7a62a1c (0x3ea1 bytes) 2024-09-21T13:58:33.236 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.236 INFO:teuthology.orchestra.run.smithi079.stdout:721 writesame 0x71c1a88 thru 0x71cccec data_size 0xd(0xb265 bytes) 2024-09-21T13:58:33.245 INFO:teuthology.orchestra.run.smithi079.stdout:722 read 0xb32d577 thru 0xb32e77c (0x1206 bytes) 2024-09-21T13:58:33.255 INFO:teuthology.orchestra.run.smithi079.stdout:723 writesame 0xed5cd03 thru 0xed5ec0a data_size 0xc(0x1f08 bytes) 2024-09-21T13:58:33.255 INFO:teuthology.orchestra.run.smithi079.stdout:725 read 0x46d51bb thru 0x46de6a7 (0x94ed bytes) 2024-09-21T13:58:33.255 INFO:teuthology.orchestra.run.smithi079.stdout:726 write 0xb1cc005 thru 0xb1cf6ec (0x36e8 bytes) 2024-09-21T13:58:33.262 INFO:teuthology.orchestra.run.smithi079.stdout:728 writesame 0x37e34a9 thru 0x37f2d87 data_size 0x3(0xf8df bytes) 2024-09-21T13:58:33.264 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:33.264 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:33.279 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:33.296 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.296 INFO:teuthology.orchestra.run.smithi079.stdout:735 punch from 0x39a9b40 to 0x39b228b, (0x874b bytes) 2024-09-21T13:58:33.296 INFO:teuthology.orchestra.run.smithi079.stdout:737 punch from 0xad43ee8 to 0xad4c5ba, (0x86d2 bytes) 2024-09-21T13:58:33.296 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.297 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xdc6f21a 2024-09-21T13:58:33.298 INFO:teuthology.orchestra.run.smithi079.stdout:741 trunc from 0xed5ec0b to 0xdc6f21a 2024-09-21T13:58:33.306 INFO:teuthology.orchestra.run.smithi079.stdout:744 write 0xad114b1 thru 0xad13144 (0x1c94 bytes) 2024-09-21T13:58:33.311 INFO:teuthology.orchestra.run.smithi079.stdout:746 writesame 0x3eda8cb thru 0x3ee60ef data_size 0x2f(0xb825 bytes) 2024-09-21T13:58:33.316 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.316 INFO:teuthology.orchestra.run.smithi079.stdout:749 write 0x480df98 thru 0x4819e39 (0xbea2 bytes) 2024-09-21T13:58:33.320 INFO:teuthology.orchestra.run.smithi079.stdout:750 read 0x20639a1 thru 0x2073017 (0xf677 bytes) 2024-09-21T13:58:33.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:33.319+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:33.321 INFO:teuthology.orchestra.run.smithi079.stdout:752 writesame 0xbbe1f5f thru 0xbbe6773 data_size 0x1(0x4815 bytes) 2024-09-21T13:58:33.349 INFO:teuthology.orchestra.run.smithi079.stdout:753 punch from 0x62babdf to 0x62c36f3, (0x8b14 bytes) 2024-09-21T13:58:33.360 INFO:teuthology.orchestra.run.smithi079.stdout:754 writesame 0xee61275 thru 0xee6b27f data_size 0x7(0xa00b bytes) 2024-09-21T13:58:33.360 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.360 INFO:teuthology.orchestra.run.smithi079.stdout:756 punch from 0xb5dd3b6 to 0xb5df8cd, (0x2517 bytes) 2024-09-21T13:58:33.360 INFO:teuthology.orchestra.run.smithi079.stdout:757 write 0xaaf1ede thru 0xaafeab5 (0xcbd8 bytes) 2024-09-21T13:58:33.366 INFO:teuthology.orchestra.run.smithi079.stdout:758 write 0x182c873 thru 0x1837e1c (0xb5aa bytes) 2024-09-21T13:58:33.369 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.369 INFO:teuthology.orchestra.run.smithi079.stdout:762 punch from 0x40203d0 to 0x402ba7c, (0xb6ac bytes) 2024-09-21T13:58:33.369 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.377 INFO:teuthology.orchestra.run.smithi079.stdout:765 trunc from 0xee6b280 to 0xb61c975 2024-09-21T13:58:33.391 INFO:teuthology.orchestra.run.smithi079.stdout:766 write 0x87f2cde thru 0x880250c (0xf82f bytes) 2024-09-21T13:58:33.394 INFO:teuthology.orchestra.run.smithi079.stdout:769 writesame 0x8e6fa67 thru 0x8e7e03e data_size 0x14(0xe5d8 bytes) 2024-09-21T13:58:33.403 INFO:teuthology.orchestra.run.smithi079.stdout:770 read 0x3117da thru 0x315127 (0x394e bytes) 2024-09-21T13:58:33.404 INFO:teuthology.orchestra.run.smithi079.stdout:771 punch from 0x89a3abe to 0x89afeb6, (0xc3f8 bytes) 2024-09-21T13:58:33.404 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.404 INFO:teuthology.orchestra.run.smithi079.stdout:773 read 0x20758 thru 0x28228 (0x7ad1 bytes) 2024-09-21T13:58:33.404 INFO:teuthology.orchestra.run.smithi079.stdout:775 writesame 0x3f44a5a thru 0x3f49fff data_size 0x13(0x55a6 bytes) 2024-09-21T13:58:33.410 INFO:teuthology.orchestra.run.smithi079.stdout:776 read 0x5666307 thru 0x566ff7b (0x9c75 bytes) 2024-09-21T13:58:33.410 INFO:teuthology.orchestra.run.smithi079.stdout:777 punch from 0xa0b0488 to 0xa0b857c, (0x80f4 bytes) 2024-09-21T13:58:33.410 INFO:teuthology.orchestra.run.smithi079.stdout:778 read 0x5eae1cc thru 0x5ebb36c (0xd1a1 bytes) 2024-09-21T13:58:33.421 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:33.421 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:33.421 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:33.421 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:33.420+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:33.422 INFO:teuthology.orchestra.run.smithi079.stdout:779 write 0xdce734e thru 0xdcf3b87 (0xc83a bytes) 2024-09-21T13:58:33.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:33.441 INFO:teuthology.orchestra.run.smithi079.stdout:781 write 0xebf284c thru 0xec00dd6 (0xe58b bytes) 2024-09-21T13:58:33.451 INFO:teuthology.orchestra.run.smithi079.stdout:782 writesame 0xa8a6e93 thru 0xa8af43c data_size 0x9(0x85aa bytes) 2024-09-21T13:58:33.460 INFO:teuthology.orchestra.run.smithi079.stdout:783 write 0x399c7c3 thru 0x39a4eb2 (0x86f0 bytes) 2024-09-21T13:58:33.471 INFO:teuthology.orchestra.run.smithi079.stdout:784 write 0x5b2c300 thru 0x5b3a53a (0xe23b bytes) 2024-09-21T13:58:33.476 INFO:teuthology.orchestra.run.smithi079.stdout:786 write 0x2031de7 thru 0x203df13 (0xc12d bytes) 2024-09-21T13:58:33.491 INFO:teuthology.orchestra.run.smithi079.stdout:787 trunc from 0xec00dd7 to 0x8523b2a 2024-09-21T13:58:33.522 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:33.520+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:33.526 INFO:teuthology.orchestra.run.smithi079.stdout:788 writesame 0x7a3f548 thru 0x7a4d26a data_size 0x1(0xdd23 bytes) 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:861 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'171, mlcod=29'167)", 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:33.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.105073559, 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002361892, 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468087+0000", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468105+0000", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7595e-05 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468115+0000", 2024-09-21T13:58:33.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0902e-05 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468124+0000", 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2819999999999996e-06 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468197+0000", 2024-09-21T13:58:33.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468232+0000", 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4703000000000003e-05 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470415+0000", 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021829739999999999 2024-09-21T13:58:33.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470450+0000", 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4885000000000002e-05 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.579 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:912 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'185, mlcod=29'183)", 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9495148599999998, 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020263149999999999, 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623645+0000", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623657+0000", 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2257e-05 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623679+0000", 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1957e-05 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623689+0000", 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623796+0000", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107624 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623853+0000", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6849999999999999e-05 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625607+0000", 2024-09-21T13:58:33.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017542600000000001 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625673+0000", 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5386e-05 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:914 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'186, mlcod=29'184)", 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.630617+0000", 2024-09-21T13:58:33.584 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9425444760000001, 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019595480000000002, 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630617+0000", 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630617+0000", 2024-09-21T13:58:33.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630616+0000", 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630622+0000", 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5570000000000001e-06 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630634+0000", 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1885000000000001e-05 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630640+0000", 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3750000000000002e-06 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630737+0000", 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7756000000000004e-05 2024-09-21T13:58:33.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.630794+0000", 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6817000000000002e-05 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.632490+0000", 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016955469999999999 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.632576+0000", 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6478999999999997e-05 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:922 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'189, mlcod=29'187)", 2024-09-21T13:58:33.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9028680859999998, 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025362470000000002, 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670291+0000", 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670307+0000", 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6393e-05 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670340+0000", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2897e-05 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670354+0000", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.42e-05 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670473+0000", 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119172 2024-09-21T13:58:33.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670511+0000", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7466999999999999e-05 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672732+0000", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002220816 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672829+0000", 2024-09-21T13:58:33.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7656000000000001e-05 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:932 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'192, mlcod=29'189)", 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.890121884, 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020005800000000001, 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683038+0000", 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683048+0000", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3530000000000001e-06 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683063+0000", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4932e-05 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683071+0000", 2024-09-21T13:58:33.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0539999999999995e-06 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683162+0000", 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1244999999999998e-05 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683185+0000", 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3328000000000001e-05 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.685012+0000", 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001826933 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.685040+0000", 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7820000000000001e-05 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1013 3.0 e29/23 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head v 29'16, mlcod=29'14)", 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.995028+0000", 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5781332060000004, 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001935544, 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995028+0000", 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995028+0000", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995027+0000", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995771+0000", 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000744249 2024-09-21T13:58:33.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995790+0000", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8759000000000001e-05 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995799+0000", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2920000000000001e-06 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995849+0000", 2024-09-21T13:58:33.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0475e-05 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.995873+0000", 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.408e-05 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.996925+0000", 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001051983 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.996964+0000", 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8189000000000003e-05 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1048 3.4 e29/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 29'221, mlcod=29'218)", 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4445668239999998, 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033734450000000001, 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128593+0000", 2024-09-21T13:58:33.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128602+0000", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128630+0000", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7260999999999999e-05 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128641+0000", 2024-09-21T13:58:33.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0994e-05 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128692+0000", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1793999999999999e-05 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128722+0000", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9870999999999999e-05 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131932+0000", 2024-09-21T13:58:33.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032095729999999999 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131968+0000", 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6031000000000001e-05 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1083 3.4 e30/23 3:27acbb70:::rbd_data.1185e8851f1.0000000000000025:head v 30'229, mlcod=29'225)", 2024-09-21T13:58:33.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3415603950000001, 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002238987, 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231600+0000", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231605+0000", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.481e-06 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231614+0000", 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4069999999999999e-06 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231620+0000", 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5439999999999998e-06 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231686+0000", 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6103000000000001e-05 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231723+0000", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6770000000000002e-05 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233790+0000", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020677730000000002 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233840+0000", 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9447000000000003e-05 2024-09-21T13:58:33.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1085 3.4 e30/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 30'230, mlcod=30'227)", 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3403371259999997, 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028868180000000002, 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232823+0000", 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232834+0000", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0621e-05 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232852+0000", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8546000000000002e-05 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232880+0000", 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7421999999999999e-05 2024-09-21T13:58:33.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232945+0000", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5514999999999999e-05 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232980+0000", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5070000000000001e-05 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235681+0000", 2024-09-21T13:58:33.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027004450000000001 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235711+0000", 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0318999999999999e-05 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1086 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'231, mlcod=30'228)", 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3382749179999998, 2024-09-21T13:58:33.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002857708, 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234885+0000", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234895+0000", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7450000000000007e-06 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234913+0000", 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.753e-05 2024-09-21T13:58:33.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234922+0000", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5470000000000002e-06 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234966+0000", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3582999999999999e-05 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234983+0000", 2024-09-21T13:58:33.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7149000000000001e-05 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237710+0000", 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027272849999999999 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237744+0000", 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3964000000000002e-05 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1087 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'232, mlcod=30'228)", 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3371248009999999, 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003476987, 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236044+0000", 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2700000000000004e-06 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236060+0000", 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5739999999999998e-05 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236068+0000", 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4430000000000003e-06 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236103+0000", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4428000000000003e-05 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236121+0000", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8099999999999999e-05 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239473+0000", 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003352486 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239513+0000", 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0343000000000003e-05 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1088 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'233, mlcod=30'229)", 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:33.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3359894739999998, 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002368682, 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:33.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237171+0000", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237177+0000", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2169999999999999e-06 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237192+0000", 2024-09-21T13:58:33.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.433e-05 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237198+0000", 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6699999999999997e-06 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237243+0000", 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4879999999999997e-05 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237261+0000", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7629999999999999e-05 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239517+0000", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022558729999999998 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239540+0000", 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3822999999999999e-05 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2331 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'295, mlcod=32'293)", 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.25910995, 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019652279999999999, 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314058+0000", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9700000000000002e-06 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314077+0000", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9029999999999999e-05 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314085+0000", 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-21T13:58:33.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314143+0000", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8535000000000001e-05 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314162+0000", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8646000000000001e-05 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.315978+0000", 2024-09-21T13:58:33.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00181632 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316017+0000", 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8096999999999998e-05 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2332 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'296, mlcod=32'294)", 2024-09-21T13:58:33.634 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2563011740000001, 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024063629999999999, 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:33.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316859+0000", 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316866+0000", 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8240000000000002e-06 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316877+0000", 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1143e-05 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316885+0000", 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8720000000000002e-06 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316923+0000", 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8092000000000001e-05 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316937+0000", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3395e-05 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319238+0000", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023008730000000002 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319266+0000", 2024-09-21T13:58:33.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8911000000000002e-05 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2347 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'298, mlcod=33'296)", 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2417438919999999, 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001993383, 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331424+0000", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6029999999999999e-06 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331440+0000", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5522000000000001e-05 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331448+0000", 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5140000000000001e-06 2024-09-21T13:58:33.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331490+0000", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1603999999999997e-05 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331511+0000", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1274999999999999e-05 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.333375+0000", 2024-09-21T13:58:33.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00186371 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.333411+0000", 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5942999999999998e-05 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2618 3.0 e33/23 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:33.643 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.73613848500000001, 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038473650000000002, 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837020+0000", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837040+0000", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0369000000000001e-05 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837084+0000", 2024-09-21T13:58:33.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3754000000000002e-05 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837107+0000", 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2606e-05 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837225+0000", 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118353 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837267+0000", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2116000000000001e-05 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840831+0000", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035635390000000001 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840870+0000", 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9304000000000002e-05 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2617 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.73517068799999996, 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034007360000000001, 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837990+0000", 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837998+0000", 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3310000000000004e-06 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838012+0000", 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3703000000000001e-05 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838019+0000", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3679999999999996e-06 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838108+0000", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9285999999999999e-05 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838154+0000", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5726999999999998e-05 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841324+0000", 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003170094 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841391+0000", 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7273000000000005e-05 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2638 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'24, mlcod=33'22)", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.70565307700000002, 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031467190000000001, 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867507+0000", 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867527+0000", 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867540+0000", 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3434999999999999e-05 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867548+0000", 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9039999999999992e-06 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867804+0000", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000255839 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867847+0000", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2883999999999998e-05 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870565+0000", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027180889999999999 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870655+0000", 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0032999999999997e-05 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3521 3.9 e33/23 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head v 33'25, mlcod=33'23)", 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.61249961100000005, 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056663929999999996, 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960646+0000", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999847 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963517+0000", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028708319999999998 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963538+0000", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0809999999999999e-05 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963547+0000", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963602+0000", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5047000000000003e-05 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963622+0000", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0227000000000001e-05 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966242+0000", 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026194790000000001 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966328+0000", 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6526000000000005e-05 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3564 3.4 e33/23 3:22fd9022:::rbd_data.1185e0e4cd61.0000000000000026:head v 33'309, mlcod=33'307)", 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.51378470099999995, 2024-09-21T13:58:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035435229999999998, 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059375+0000", 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059453+0000", 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7869999999999998e-05 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059486+0000", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3389000000000002e-05 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059505+0000", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8686999999999999e-05 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059569+0000", 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4033000000000002e-05 2024-09-21T13:58:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059599+0000", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9895000000000001e-05 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062879+0000", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032800080000000001 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062920+0000", 2024-09-21T13:58:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1467999999999997e-05 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:33.666 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:33.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:33.668 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.668 INFO:teuthology.orchestra.run.smithi079.stdout:790 read 0x699c706 thru 0x69a7156 (0xaa51 bytes) 2024-09-21T13:58:33.668 INFO:teuthology.orchestra.run.smithi079.stdout:791 writesame 0x44f21b1 thru 0x44f8a58 data_size 0x44(0x68a8 bytes) 2024-09-21T13:58:33.668 INFO:teuthology.orchestra.run.smithi079.stdout:794 write 0xdf3d4a0 thru 0xdf4025a (0x2dbb bytes) 2024-09-21T13:58:33.669 INFO:teuthology.orchestra.run.smithi079.stdout:796 writesame 0x1ec4bae thru 0x1ed31b7 data_size 0x97(0xe60a bytes) 2024-09-21T13:58:33.669 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.669 INFO:teuthology.orchestra.run.smithi079.stdout:798 trunc from 0xdf4025b to 0x927b0f9 2024-09-21T13:58:33.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:33.667+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:33.674 INFO:teuthology.orchestra.run.smithi079.stdout:799 write 0x7ed6e9d thru 0x7ede746 (0x78aa bytes) 2024-09-21T13:58:33.681 INFO:teuthology.orchestra.run.smithi079.stdout:800 writesame 0x66b80e8 thru 0x66c06f7 data_size 0x42(0x8610 bytes) 2024-09-21T13:58:33.688 INFO:teuthology.orchestra.run.smithi079.stdout:801 punch from 0xeca33b to 0xece672, (0x4337 bytes) 2024-09-21T13:58:33.708 INFO:teuthology.orchestra.run.smithi079.stdout:802 write 0xe59f27d thru 0xe5a3274 (0x3ff8 bytes) 2024-09-21T13:58:33.723 INFO:teuthology.orchestra.run.smithi079.stdout:803 trunc from 0xe5a3275 to 0x95eb2d5 2024-09-21T13:58:33.748 INFO:teuthology.orchestra.run.smithi079.stdout:804 trunc from 0x95eb2d5 to 0x9460ba3 2024-09-21T13:58:33.767 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:33.767+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:33.779 INFO:teuthology.orchestra.run.smithi079.stdout:805 write 0xb8fb619 thru 0xb90b3b5 (0xfd9d bytes) 2024-09-21T13:58:33.806 INFO:teuthology.orchestra.run.smithi079.stdout:807 trunc from 0xb90b3b6 to 0xcefcc0 2024-09-21T13:58:33.823 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:33.823 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:33.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:33.869 INFO:teuthology.orchestra.run.smithi079.stdout:808 writesame 0x814486b thru 0x814517f data_size 0x3(0x915 bytes) 2024-09-21T13:58:33.869 INFO:teuthology.orchestra.run.smithi079.stdout:809 write 0x758b89e thru 0x759339f (0x7b02 bytes) 2024-09-21T13:58:33.869 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:33.867+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:33.876 INFO:teuthology.orchestra.run.smithi079.stdout:810 writesame 0x5542d6b thru 0x5552049 data_size 0x19(0xf2df bytes) 2024-09-21T13:58:33.881 INFO:teuthology.orchestra.run.smithi079.stdout:811 punch from 0x496aefc to 0x497964f, (0xe753 bytes) 2024-09-21T13:58:33.881 INFO:teuthology.orchestra.run.smithi079.stdout:812 read 0x581ef3a thru 0x582a95b (0xba22 bytes) 2024-09-21T13:58:33.881 INFO:teuthology.orchestra.run.smithi079.stdout:813 punch from 0x124e45e to 0x125a883, (0xc425 bytes) 2024-09-21T13:58:33.891 INFO:teuthology.orchestra.run.smithi079.stdout:815 write 0x90d2f24 thru 0x90d36ba (0x797 bytes) 2024-09-21T13:58:33.903 INFO:teuthology.orchestra.run.smithi079.stdout:817 trunc from 0x90d36bb to 0x545e6e8 2024-09-21T13:58:33.937 INFO:teuthology.orchestra.run.smithi079.stdout:818 write 0x9edfe39 thru 0x9ee28b9 (0x2a81 bytes) 2024-09-21T13:58:33.945 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xe6ffc10 2024-09-21T13:58:33.952 INFO:teuthology.orchestra.run.smithi079.stdout:819 trunc from 0x9ee28ba to 0xe6ffc10 2024-09-21T13:58:33.960 INFO:teuthology.orchestra.run.smithi079.stdout:821 read 0x8b5f781 thru 0x8b6dee1 (0xe761 bytes) 2024-09-21T13:58:33.960 INFO:teuthology.orchestra.run.smithi079.stdout:822 punch from 0x403c2ae to 0x403ff4c, (0x3c9e bytes) 2024-09-21T13:58:33.960 INFO:teuthology.orchestra.run.smithi079.stdout:823 read 0x6cd3877 thru 0x6ce1424 (0xdbae bytes) 2024-09-21T13:58:33.960 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:33.963 INFO:teuthology.orchestra.run.smithi079.stdout:825 trunc from 0xe6ffc10 to 0xc5cd391 2024-09-21T13:58:33.969 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:33.968+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:33.972 INFO:teuthology.orchestra.run.smithi079.stdout:826 write 0x7181e86 thru 0x71839c6 (0x1b41 bytes) 2024-09-21T13:58:33.979 INFO:teuthology.orchestra.run.smithi079.stdout:828 read 0x37c1e88 thru 0x37c59fc (0x3b75 bytes) 2024-09-21T13:58:33.979 INFO:teuthology.orchestra.run.smithi079.stdout:830 read 0x38f49fe thru 0x39046ee (0xfcf1 bytes) 2024-09-21T13:58:33.989 INFO:teuthology.orchestra.run.smithi079.stdout:831 write 0xd2c1ff6 thru 0xd2c7e1f (0x5e2a bytes) 2024-09-21T13:58:33.995 INFO:teuthology.orchestra.run.smithi079.stdout:832 punch from 0x83e1da7 to 0x83e1f9c, (0x1f5 bytes) 2024-09-21T13:58:33.995 INFO:teuthology.orchestra.run.smithi079.stdout:835 writesame 0x86d6c7 thru 0x871ffb data_size 0x1(0x4935 bytes) 2024-09-21T13:58:33.998 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:33.998 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:33.999 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:33.999 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:34.012 INFO:teuthology.orchestra.run.smithi079.stdout:836 punch from 0x6a90ca4 to 0x6a95479, (0x47d5 bytes) 2024-09-21T13:58:34.012 INFO:teuthology.orchestra.run.smithi079.stdout:837 read 0x2653ca4 thru 0x265ccca (0x9027 bytes) 2024-09-21T13:58:34.012 INFO:teuthology.orchestra.run.smithi079.stdout:841 write 0x9c4b761 thru 0x9c5158b (0x5e2b bytes) 2024-09-21T13:58:34.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:34.019 INFO:teuthology.orchestra.run.smithi079.stdout:843 write 0x780f38a thru 0x78149b2 (0x5629 bytes) 2024-09-21T13:58:34.025 INFO:teuthology.orchestra.run.smithi079.stdout:844 write 0x5257d17 thru 0x52597c2 (0x1aac bytes) 2024-09-21T13:58:34.031 INFO:teuthology.orchestra.run.smithi079.stdout:845 write 0x8d16f8e thru 0x8d1cf16 (0x5f89 bytes) 2024-09-21T13:58:34.035 INFO:teuthology.orchestra.run.smithi079.stdout:846 punch from 0x87b2e42 to 0x87c02b3, (0xd471 bytes) 2024-09-21T13:58:34.035 INFO:teuthology.orchestra.run.smithi079.stdout:848 read 0xb4aac1c thru 0xb4ab692 (0xa77 bytes) 2024-09-21T13:58:34.036 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.036 INFO:teuthology.orchestra.run.smithi079.stdout:851 punch from 0x45743bc to 0x458324c, (0xee90 bytes) 2024-09-21T13:58:34.036 INFO:teuthology.orchestra.run.smithi079.stdout:852 read 0x218be9c thru 0x218e4dd (0x2642 bytes) 2024-09-21T13:58:34.036 INFO:teuthology.orchestra.run.smithi079.stdout:853 read 0x8a35cc4 thru 0x8a44ccc (0xf009 bytes) 2024-09-21T13:58:34.037 INFO:teuthology.orchestra.run.smithi079.stdout:854 read 0x610e6fc thru 0x611e1f5 (0xfafa bytes) 2024-09-21T13:58:34.050 INFO:teuthology.orchestra.run.smithi079.stdout:855 write 0xeb12261 thru 0xeb22047 (0xfde7 bytes) 2024-09-21T13:58:34.059 INFO:teuthology.orchestra.run.smithi079.stdout:857 read 0x851b9c7 thru 0x8529506 (0xdb40 bytes) 2024-09-21T13:58:34.059 INFO:teuthology.orchestra.run.smithi079.stdout:858 read 0xb3301c5 thru 0xb33708d (0x6ec9 bytes) 2024-09-21T13:58:34.059 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.060 INFO:teuthology.orchestra.run.smithi079.stdout:860 writesame 0x3d2878e thru 0x3d2a535 data_size 0x1a(0x1da8 bytes) 2024-09-21T13:58:34.066 INFO:teuthology.orchestra.run.smithi079.stdout:861 writesame 0x4e31be2 thru 0x4e3c018 data_size 0x1b(0xa437 bytes) 2024-09-21T13:58:34.070 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:34.068+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:34.070 INFO:teuthology.orchestra.run.smithi079.stdout:862 write 0x77f700c thru 0x77f8c0b (0x1c00 bytes) 2024-09-21T13:58:34.077 INFO:teuthology.orchestra.run.smithi079.stdout:863 read 0xe1f2d3c thru 0xe1f6e9c (0x4161 bytes) 2024-09-21T13:58:34.077 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.077 INFO:teuthology.orchestra.run.smithi079.stdout:866 punch from 0x6f92dd6 to 0x6f9a8fc, (0x7b26 bytes) 2024-09-21T13:58:34.077 INFO:teuthology.orchestra.run.smithi079.stdout:867 write 0xd0b0e60 thru 0xd0b9cbc (0x8e5d bytes) 2024-09-21T13:58:34.082 INFO:teuthology.orchestra.run.smithi079.stdout:868 trunc from 0xeb22048 to 0xe4b4e7e 2024-09-21T13:58:34.093 INFO:teuthology.orchestra.run.smithi079.stdout:869 write 0x3a7ff2b thru 0x3a86a28 (0x6afe bytes) 2024-09-21T13:58:34.110 INFO:teuthology.orchestra.run.smithi079.stdout:870 writesame 0xe663b6f thru 0xe6645a9 data_size 0x9(0xa3b bytes) 2024-09-21T13:58:34.110 INFO:teuthology.orchestra.run.smithi079.stdout:871 punch from 0xb9663c4 to 0xb973eca, (0xdb06 bytes) 2024-09-21T13:58:34.110 INFO:teuthology.orchestra.run.smithi079.stdout:872 punch from 0x582b595 to 0x5830bb7, (0x5622 bytes) 2024-09-21T13:58:34.110 INFO:teuthology.orchestra.run.smithi079.stdout:873 writesame 0x8841db8 thru 0x8847309 data_size 0x43(0x5552 bytes) 2024-09-21T13:58:34.117 INFO:teuthology.orchestra.run.smithi079.stdout:874 write 0x5ea3a95 thru 0x5eab658 (0x7bc4 bytes) 2024-09-21T13:58:34.136 INFO:teuthology.orchestra.run.smithi079.stdout:875 trunc from 0xe6645aa to 0x6ea827e 2024-09-21T13:58:34.159 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:34.159 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:892 3.8 3:12eebb35:::rbd_data.1185e8851f1.000000000000004c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.6280778360000001, 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020018940999999998, 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 892 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529203+0000", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529218+0000", 2024-09-21T13:58:34.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4752999999999999e-05 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529248+0000", 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0243000000000002e-05 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529263+0000", 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5133000000000001e-05 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529338+0000", 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5007999999999997e-05 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529518+0000", 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000179746 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.533389+0000", 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038712059999999999 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549140+0000", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015751304000000001 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549151+0000", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0934000000000001e-05 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549192+0000", 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0432999999999997e-05 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549224+0000", 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2724e-05 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2578 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.3926723650000001, 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012623001, 2024-09-21T13:58:34.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2578 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764610+0000", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764617+0000", 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764629+0000", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1481000000000001e-05 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764637+0000", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0930000000000003e-06 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.770932+0000", 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062953649999999998 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771018+0000", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5124999999999996e-05 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771397+0000", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037906700000000002 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.773596+0000", 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002199201 2024-09-21T13:58:34.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777182+0000", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035860750000000002 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777211+0000", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9600000000000001e-05 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777234+0000", 2024-09-21T13:58:34.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2306999999999998e-05 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2579 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.39259698, 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01507579, 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2579 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764685+0000", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764691+0000", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4670000000000003e-06 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764700+0000", 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8430000000000005e-06 2024-09-21T13:58:34.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764708+0000", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1899999999999998e-06 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771834+0000", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071266250000000001 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771900+0000", 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5405000000000001e-05 2024-09-21T13:58:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.772103+0000", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000203816 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.773604+0000", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001500953 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779710+0000", 2024-09-21T13:58:34.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006105376 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779741+0000", 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1053999999999998e-05 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779762+0000", 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1094000000000002e-05 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2678 3.18 3:189e6eaa:::rbd_data.11854cc47015.0000000000000061:7 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2782210969999999, 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017838525000000001, 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2678 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879061+0000", 2024-09-21T13:58:34.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879067+0000", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.703e-06 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879083+0000", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879096+0000", 2024-09-21T13:58:34.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.289e-05 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.882617+0000", 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035206669999999999 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.882768+0000", 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015083100000000001 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.896901+0000", 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014132831 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2925 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.885952+0000", 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2713312649999999, 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011518791, 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2925 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885952+0000", 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885952+0000", 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885951+0000", 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885956+0000", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6310000000000002e-06 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885969+0000", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3016999999999999e-05 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885979+0000", 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0117e-05 2024-09-21T13:58:34.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897001+0000", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011022354999999999 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897157+0000", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015551000000000001 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897471+0000", 2024-09-21T13:58:34.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031392699999999998 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2926 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 425984~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.885988+0000", 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2712953599999999, 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011999532, 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2926 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885988+0000", 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885988+0000", 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.885987+0000", 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886003+0000", 2024-09-21T13:58:34.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5624000000000002e-05 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886017+0000", 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4171e-05 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886029+0000", 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2476999999999999e-05 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897531+0000", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011502073999999999 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897694+0000", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016223600000000001 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.897987+0000", 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029363499999999999 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2927 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2712446929999999, 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012443088, 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2927 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886042+0000", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7650000000000001e-06 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886056+0000", 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3682e-05 2024-09-21T13:58:34.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886066+0000", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6830000000000003e-06 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898045+0000", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011979049 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898254+0000", 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000208784 2024-09-21T13:58:34.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898482+0000", 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022792999999999999 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2928 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 491520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.271208414, 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013336162, 2024-09-21T13:58:34.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2928 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886074+0000", 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886079+0000", 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7620000000000003e-06 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886092+0000", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3329999999999999e-05 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886102+0000", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0044000000000001e-05 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898618+0000", 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012515849000000001 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898785+0000", 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016707700000000001 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899411+0000", 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000626094 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.200 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2930 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2711715260000001, 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013379779, 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2930 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886111+0000", 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886116+0000", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9570000000000001e-06 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886129+0000", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3424999999999999e-05 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886151+0000", 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2073999999999999e-05 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899474+0000", 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013322791 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899491+0000", 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7492000000000001e-05 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2931 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.204 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2711221720000001, 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013397617000000001, 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2931 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:34.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886160+0000", 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886165+0000", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8670000000000002e-06 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886179+0000", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3706999999999999e-05 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886188+0000", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3200000000000006e-06 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899543+0000", 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013354662 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899559+0000", 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5970000000000001e-05 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2932 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:34.208 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.271084297, 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013487984, 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2932 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886198+0000", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886203+0000", 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7500000000000003e-06 2024-09-21T13:58:34.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886216+0000", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886984+0000", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076842000000000002 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899668+0000", 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012684436 2024-09-21T13:58:34.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899687+0000", 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8456000000000001e-05 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2933 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2702794049999999, 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012806563, 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.212 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2933 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:34.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887002+0000", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887044+0000", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1810000000000001e-05 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887065+0000", 2024-09-21T13:58:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0809999999999999e-05 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887080+0000", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4832e-05 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899793+0000", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012712864000000001 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899810+0000", 2024-09-21T13:58:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7665000000000001e-05 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2977 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2701906860000001, 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012787886, 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2977 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887091+0000", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887097+0000", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9039999999999997e-06 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887112+0000", 2024-09-21T13:58:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5159e-05 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887124+0000", 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1304999999999999e-05 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899864+0000", 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012740227 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899880+0000", 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6351999999999999e-05 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2978 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.270149491, 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012812085000000001, 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2978 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887133+0000", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888480+0000", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001347067 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888499+0000", 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9122000000000001e-05 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888513+0000", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4295e-05 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899930+0000", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011416397999999999 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899946+0000", 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6135999999999999e-05 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3511 3.7 3:e0f17847:::rbd_data.1185e0e4cd61.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2241619340000001, 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019117536000000001, 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3511 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.224 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933120+0000", 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:34.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934347+0000", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012266390000000001 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934358+0000", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1223000000000001e-05 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934365+0000", 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0260000000000002e-06 2024-09-21T13:58:34.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934395+0000", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9481000000000001e-05 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934491+0000", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6508000000000005e-05 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934794+0000", 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030285099999999998 2024-09-21T13:58:34.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941226+0000", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064324129999999997 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952151+0000", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010924476000000001 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952188+0000", 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7045000000000002e-05 2024-09-21T13:58:34.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952239+0000", 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0807999999999999e-05 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3512 3.7 3:e75521fd:::rbd_data.1185e0e4cd61.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2226343960000001, 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019612041, 2024-09-21T13:58:34.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3512 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934647+0000", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935627+0000", 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00097970299999999995 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935638+0000", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1055e-05 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935643+0000", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7690000000000004e-06 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937250+0000", 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001607151 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937409+0000", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000159476 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937803+0000", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000393481 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941245+0000", 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003442498 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954200+0000", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012955022 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954236+0000", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5673000000000002e-05 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954261+0000", 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4632000000000001e-05 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3513 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2216339760000001, 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019324754, 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3513 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.235 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935648+0000", 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:34.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935651+0000", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9380000000000001e-06 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935656+0000", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5290000000000002e-06 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935659+0000", 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.824e-06 2024-09-21T13:58:34.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.939409+0000", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037498789999999998 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.939542+0000", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013348799999999999 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940068+0000", 2024-09-21T13:58:34.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052610500000000002 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942295+0000", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022266719999999999 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954924+0000", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012629494 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954954+0000", 2024-09-21T13:58:34.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9586000000000001e-05 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954974+0000", 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.995e-05 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3515 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.218831185, 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016634667999999998, 2024-09-21T13:58:34.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3515 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938449+0000", 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938462+0000", 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2323999999999999e-05 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938477+0000", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5308999999999999e-05 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938488+0000", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0984e-05 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940547+0000", 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002059291 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940640+0000", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2429999999999994e-05 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940925+0000", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028547000000000002 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942656+0000", 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017311819999999999 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955015+0000", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012358549 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955054+0000", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8682e-05 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955087+0000", 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3013999999999999e-05 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3516 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.216677633, 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014605259000000001, 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3516 2024-09-21T13:58:34.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940604+0000", 2024-09-21T13:58:34.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940613+0000", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9339999999999995e-06 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940623+0000", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0713999999999999e-05 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940636+0000", 2024-09-21T13:58:34.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2554999999999999e-05 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941272+0000", 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00063589699999999996 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941338+0000", 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5949000000000002e-05 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941541+0000", 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020328100000000001 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942663+0000", 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011223030000000001 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955135+0000", 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012471996000000001 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955181+0000", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5865999999999998e-05 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955211+0000", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9515000000000001e-05 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3517 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.943051+0000", 2024-09-21T13:58:34.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.2142321300000001, 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012292005999999999, 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3517 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943051+0000", 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943051+0000", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943050+0000", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943057+0000", 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1770000000000001e-06 2024-09-21T13:58:34.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943068+0000", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1497e-05 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943075+0000", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4729999999999997e-06 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943120+0000", 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5147e-05 2024-09-21T13:58:34.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943212+0000", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1940000000000004e-05 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.943600+0000", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038797799999999998 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.945056+0000", 2024-09-21T13:58:34.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014562329999999999 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955268+0000", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010212278999999999 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955300+0000", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1832999999999998e-05 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955343+0000", 2024-09-21T13:58:34.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2741000000000003e-05 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:34.257 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:34.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:34.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:58:34.259 INFO:teuthology.orchestra.run.smithi079.stdout:876 read 0x6e0d503 thru 0x6e19914 (0xc412 bytes) 2024-09-21T13:58:34.259 INFO:teuthology.orchestra.run.smithi079.stdout:877 read 0x1e81797 thru 0x1e88495 (0x6cff bytes) 2024-09-21T13:58:34.259 INFO:teuthology.orchestra.run.smithi079.stdout:878 writesame 0xdb5193 thru 0xdc228a data_size 0x24(0xd0f8 bytes) 2024-09-21T13:58:34.259 INFO:teuthology.orchestra.run.smithi079.stdout:880 punch from 0x68d5b18 to 0x68d7f85, (0x246d bytes) 2024-09-21T13:58:34.259 INFO:teuthology.orchestra.run.smithi079.stdout:881 read 0x4eae007 thru 0x4eb9169 (0xb163 bytes) 2024-09-21T13:58:34.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:882 trunc from 0x6ea827e to 0xbc57dc1 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:883 read 0x30842a thru 0x30c93d (0x4514 bytes) 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:884 trunc from 0xbc57dc1 to 0x96c242f 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:885 write 0xbb90e2e thru 0xbb96715 (0x58e8 bytes) 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.261 INFO:teuthology.orchestra.run.smithi079.stdout:887 read 0x8160504 thru 0x8166559 (0x6056 bytes) 2024-09-21T13:58:34.262 INFO:teuthology.orchestra.run.smithi079.stdout:889 write 0xa00833e thru 0xa010ae1 (0x87a4 bytes) 2024-09-21T13:58:34.262 INFO:teuthology.orchestra.run.smithi079.stdout:890 write 0x9b59cd7 thru 0x9b65f7f (0xc2a9 bytes) 2024-09-21T13:58:34.262 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.262 INFO:teuthology.orchestra.run.smithi079.stdout:892 write 0x5097ac9 thru 0x50a3c9e (0xc1d6 bytes) 2024-09-21T13:58:34.262 INFO:teuthology.orchestra.run.smithi079.stdout:893 read 0x7667597 thru 0x766a93b (0x33a5 bytes) 2024-09-21T13:58:34.262 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:34.259+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:34.266 INFO:teuthology.orchestra.run.smithi079.stdout:895 trunc from 0xbb96716 to 0x49ea1a8 2024-09-21T13:58:34.296 INFO:teuthology.orchestra.run.smithi079.stdout:896 read 0x3e80ae2 thru 0x3e88c59 (0x8178 bytes) 2024-09-21T13:58:34.301 INFO:teuthology.orchestra.run.smithi079.stdout:897 trunc from 0x49ea1a8 to 0x28f43c9 2024-09-21T13:58:34.324 INFO:teuthology.orchestra.run.smithi079.stdout:898 read 0x16dee99 thru 0x16e5b77 (0x6cdf bytes) 2024-09-21T13:58:34.324 INFO:teuthology.orchestra.run.smithi079.stdout:899 punch from 0x676a42 to 0x6816c8, (0xac86 bytes) 2024-09-21T13:58:34.334 INFO:teuthology.orchestra.run.smithi079.stdout:901 trunc from 0x28f43c9 to 0x84b2b3e 2024-09-21T13:58:34.341 INFO:teuthology.orchestra.run.smithi079.stdout:902 write 0x7a1e9d1 thru 0x7a25a59 (0x7089 bytes) 2024-09-21T13:58:34.349 INFO:teuthology.orchestra.run.smithi079.stdout:903 trunc from 0x84b2b3e to 0xa036f3a 2024-09-21T13:58:34.356 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.356 INFO:teuthology.orchestra.run.smithi079.stdout:906 writesame 0x7c5b358 thru 0x7c66c69 data_size 0x1(0xb912 bytes) 2024-09-21T13:58:34.359 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:34.356+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:34.378 INFO:teuthology.orchestra.run.smithi079.stdout:907 write 0xcc02bb thru 0xccd30b (0xd051 bytes) 2024-09-21T13:58:34.381 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.381 INFO:teuthology.orchestra.run.smithi079.stdout:910 read 0x441d265 thru 0x4424f49 (0x7ce5 bytes) 2024-09-21T13:58:34.381 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.382 INFO:teuthology.orchestra.run.smithi079.stdout:913 write 0x6f54327 thru 0x6f5cda3 (0x8a7d bytes) 2024-09-21T13:58:34.386 INFO:teuthology.orchestra.run.smithi079.stdout:914 write 0x7878aaf thru 0x7887df3 (0xf345 bytes) 2024-09-21T13:58:34.405 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:34.405 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:34.405 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:34.406 INFO:teuthology.orchestra.run.smithi079.stdout:915 write 0xd926cba thru 0xd92d809 (0x6b50 bytes) 2024-09-21T13:58:34.410 INFO:teuthology.orchestra.run.smithi079.stdout:918 write 0x1175ccc thru 0x117dfaa (0x82df bytes) 2024-09-21T13:58:34.420 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:34.422 INFO:teuthology.orchestra.run.smithi079.stdout:920 write 0xece29fb thru 0xecece22 (0xa428 bytes) 2024-09-21T13:58:34.426 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.431 INFO:teuthology.orchestra.run.smithi079.stdout:924 trunc from 0xecece23 to 0xc2905ea 2024-09-21T13:58:34.434 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:34.434 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:34.443 INFO:teuthology.orchestra.run.smithi079.stdout:925 punch from 0x2ad661a to 0x2ae0274, (0x9c5a bytes) 2024-09-21T13:58:34.446 INFO:teuthology.orchestra.run.smithi079.stdout:926 trunc from 0xc2905ea to 0xac4d5be 2024-09-21T13:58:34.453 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:34.453 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:34.457 INFO:teuthology.orchestra.run.smithi079.stdout:927 write 0x9db53b9 thru 0x9db7ffe (0x2c46 bytes) 2024-09-21T13:58:34.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:34.459+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:34.471 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:34.471 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:34.475 INFO:teuthology.orchestra.run.smithi079.stdout:928 trunc from 0xac4d5be to 0x2da8bac 2024-09-21T13:58:34.492 INFO:teuthology.orchestra.run.smithi079.stdout:930 trunc from 0x2da8bac to 0x55a7048 2024-09-21T13:58:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:931 write 0xbd0f490 thru 0xbd130f6 (0x3c67 bytes) 2024-09-21T13:58:34.518 INFO:teuthology.orchestra.run.smithi079.stdout:933 write 0x4926fc0 thru 0x4936c50 (0xfc91 bytes) 2024-09-21T13:58:34.522 INFO:teuthology.orchestra.run.smithi079.stdout:934 punch from 0x9ed2e49 to 0x9ed679d, (0x3954 bytes) 2024-09-21T13:58:34.522 INFO:teuthology.orchestra.run.smithi079.stdout:935 write 0x663e98a thru 0x6641d7b (0x33f2 bytes) 2024-09-21T13:58:34.527 INFO:teuthology.orchestra.run.smithi079.stdout:936 write 0xb541e2d thru 0xb542a1b (0xbef bytes) 2024-09-21T13:58:34.532 INFO:teuthology.orchestra.run.smithi079.stdout:937 trunc from 0xbd130f7 to 0xb39ea3e 2024-09-21T13:58:34.548 INFO:teuthology.orchestra.run.smithi079.stdout:938 writesame 0xcb2d985 thru 0xcb3a986 data_size 0x1e(0xd002 bytes) 2024-09-21T13:58:34.558 INFO:teuthology.orchestra.run.smithi079.stdout:939 write 0xeccadd6 thru 0xecd8e00 (0xe02b bytes) 2024-09-21T13:58:34.561 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:34.560+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:940 punch from 0xa252807 to 0xa2547d3, (0x1fcc bytes) 2024-09-21T13:58:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:941 read 0xa106d3d thru 0xa114429 (0xd6ed bytes) 2024-09-21T13:58:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:943 read 0xcc88893 thru 0xcc8bac8 (0x3236 bytes) 2024-09-21T13:58:34.562 INFO:teuthology.orchestra.run.smithi079.stdout:944 writesame 0x6822306 thru 0x6831507 data_size 0x1(0xf202 bytes) 2024-09-21T13:58:34.598 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:34.599 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:34.599 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:34.602 INFO:teuthology.orchestra.run.smithi079.stdout:946 read 0x6362f5e thru 0x6372c0a (0xfcad bytes) 2024-09-21T13:58:34.603 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:34.603 INFO:teuthology.orchestra.run.smithi079.stdout:949 write 0x107ebe6 thru 0x108c1c0 (0xd5db bytes) 2024-09-21T13:58:34.607 INFO:teuthology.orchestra.run.smithi079.stdout:950 clone 5 order 22 su 2097152 sc 14 2024-09-21T13:58:34.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:34.662 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:34.663+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:34.694 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:34.694 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:34.712 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:34.712 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:34.738 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:34.738 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:34.763 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:34.760+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:34.764 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:34.764 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:34.778 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:34.778 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:34.789 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:34.790 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:34.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:34.864 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:34.863+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:34.954 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:34.954 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:34.965 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:34.967+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:34.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:35.066 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:35.064+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:35.092 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:35.092 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:35.105 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:35.198 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:35.196+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:35.241 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:58:35.267 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:35.264+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:35.276 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:35.276 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:35.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:35.369 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:35.367+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:35.400 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone4 from 0xecd8e01 (overlap 0xcefcc0) to 0xba49e0 2024-09-21T13:58:35.459 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:35.460 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:35.468 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:35.464+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:35.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:35.569 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:35.568+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:35.648 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:35.648 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:35.663 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:35.664 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-21T13:58:35.672 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:35.671+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:35.774 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:35.768+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:35.850 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:35.850 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:35.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:35.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:35.871+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:35.974 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:35.975+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:36.024 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.024 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.035 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.035 INFO:teuthology.orchestra.run.smithi079.stdout:954 punch from 0xcc0572b to 0xcc10be5, (0xb4ba bytes) 2024-09-21T13:58:36.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:36.043 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.043 INFO:teuthology.orchestra.run.smithi079.stdout:956 read 0x1ecbf34 thru 0x1ed1ce8 (0x5db5 bytes) 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:957 read 0x75b0a96 thru 0x75b91df (0x874a bytes) 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:960 punch from 0x7b1f781 to 0x7b20bfe, (0x147d bytes) 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:962 punch from 0x89eba78 to 0x89f5740, (0x9cc8 bytes) 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:963 read 0xc628e2f thru 0xc62f78a (0x695c bytes) 2024-09-21T13:58:36.044 INFO:teuthology.orchestra.run.smithi079.stdout:964 read 0x6821643 thru 0x6827345 (0x5d03 bytes) 2024-09-21T13:58:36.045 INFO:teuthology.orchestra.run.smithi079.stdout:967 read 0xd3a4913 thru 0xd3abf35 (0x7623 bytes) 2024-09-21T13:58:36.045 INFO:teuthology.orchestra.run.smithi079.stdout:968 write 0xdaaaa4 thru 0xdb6434 (0xb991 bytes) 2024-09-21T13:58:36.057 INFO:teuthology.orchestra.run.smithi079.stdout:971 read 0xc09ac6a thru 0xc09dd23 (0x30ba bytes) 2024-09-21T13:58:36.057 INFO:teuthology.orchestra.run.smithi079.stdout:972 writesame 0x40ebea9 thru 0x40fbd7b data_size 0x5(0xfed3 bytes) 2024-09-21T13:58:36.071 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xed98a61 2024-09-21T13:58:36.071 INFO:teuthology.orchestra.run.smithi079.stdout:973 trunc from 0xecd8e01 to 0xed98a61 2024-09-21T13:58:36.074 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:36.075+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:36.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:36.079 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:36.079 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-21T13:58:36.079 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T13:58:36.079 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T13:58:36.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-21T13:58:36.082 INFO:teuthology.orchestra.run.smithi079.stdout:974 write 0x4c6efeb thru 0x4c747c0 (0x57d6 bytes) 2024-09-21T13:58:36.089 INFO:teuthology.orchestra.run.smithi079.stdout:975 trunc from 0xed98a61 to 0xda469a2 2024-09-21T13:58:36.105 INFO:teuthology.orchestra.run.smithi079.stdout:976 read 0x238ca66 thru 0x239bde2 (0xf37d bytes) 2024-09-21T13:58:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:977 punch from 0x7dc4863 to 0x7dce1d0, (0x996d bytes) 2024-09-21T13:58:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:978 read 0x37bd22c thru 0x37c8d91 (0xbb66 bytes) 2024-09-21T13:58:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:979 read 0xa25a09b thru 0xa25d22d (0x3193 bytes) 2024-09-21T13:58:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:982 read 0x1bc3260 thru 0x1bcdc9f (0xaa40 bytes) 2024-09-21T13:58:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:983 read 0x345e278 thru 0x34632ca (0x5053 bytes) 2024-09-21T13:58:36.107 INFO:teuthology.orchestra.run.smithi079.stdout:984 writesame 0x752de66 thru 0x7531cd1 data_size 0x55(0x3e6c bytes) 2024-09-21T13:58:36.112 INFO:teuthology.orchestra.run.smithi079.stdout:985 trunc from 0xda469a2 to 0xcb4c844 2024-09-21T13:58:36.131 INFO:teuthology.orchestra.run.smithi079.stdout:987 write 0x87a3fc0 thru 0x87af071 (0xb0b2 bytes) 2024-09-21T13:58:36.136 INFO:teuthology.orchestra.run.smithi079.stdout:988 read 0x32296bb thru 0x322a357 (0xc9d bytes) 2024-09-21T13:58:36.143 INFO:teuthology.orchestra.run.smithi079.stdout:989 writesame 0xcbccec0 thru 0xcbd7623 data_size 0x6(0xa764 bytes) 2024-09-21T13:58:36.144 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.144 INFO:teuthology.orchestra.run.smithi079.stdout:993 read 0x1cfdb98 thru 0x1d076fa (0x9b63 bytes) 2024-09-21T13:58:36.155 INFO:teuthology.orchestra.run.smithi079.stdout:994 write 0xdf8f395 thru 0xdf92878 (0x34e4 bytes) 2024-09-21T13:58:36.157 INFO:teuthology.orchestra.run.smithi079.stdout:995 write 0x6dd2ef thru 0x6ec616 (0xf328 bytes) 2024-09-21T13:58:36.171 INFO:teuthology.orchestra.run.smithi079.stdout:998 write 0x1370a06 thru 0x1377c7d (0x7278 bytes) 2024-09-21T13:58:36.173 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.173 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.175 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:36.172+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:36.179 INFO:teuthology.orchestra.run.smithi079.stdout:999 read 0x8da8044 thru 0x8db587d (0xd83a bytes) 2024-09-21T13:58:36.179 INFO:teuthology.orchestra.run.smithi079.stdout:1004 writesame 0xece25b thru 0xece8c4 data_size 0x1(0x66a bytes) 2024-09-21T13:58:36.186 INFO:teuthology.orchestra.run.smithi079.stdout:1005 write 0xb1d5936 thru 0xb1d8dc2 (0x348d bytes) 2024-09-21T13:58:36.188 INFO:teuthology.orchestra.run.smithi079.stdout:1006 read 0xdbd63e2 thru 0xdbe377c (0xd39b bytes) 2024-09-21T13:58:36.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:36.190 INFO:teuthology.orchestra.run.smithi079.stdout:1007 writesame 0x6b7143c thru 0x6b79558 data_size 0x1(0x811d bytes) 2024-09-21T13:58:36.217 INFO:teuthology.orchestra.run.smithi079.stdout:1008 writesame 0x2e2ce9d thru 0x2e2d516 data_size 0x1(0x67a bytes) 2024-09-21T13:58:36.219 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:36.219 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T13:58:36.219 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:36.220 INFO:teuthology.orchestra.run.smithi079.stdout:1009 write 0xce77a49 thru 0xce87833 (0xfdeb bytes) 2024-09-21T13:58:36.221 INFO:teuthology.orchestra.run.smithi079.stdout:1010 writesame 0x82f75c8 thru 0x830082a data_size 0x5(0x9263 bytes) 2024-09-21T13:58:36.231 INFO:teuthology.orchestra.run.smithi079.stdout:1011 write 0x666dcfa thru 0x666ebff (0xf06 bytes) 2024-09-21T13:58:36.238 INFO:teuthology.orchestra.run.smithi079.stdout:1013 writesame 0xc68f4eb thru 0xc697f08 data_size 0x53(0x8a1e bytes) 2024-09-21T13:58:36.242 INFO:teuthology.orchestra.run.smithi079.stdout:1014 read 0x2b3e590 thru 0x2b40954 (0x23c5 bytes) 2024-09-21T13:58:36.243 INFO:teuthology.orchestra.run.smithi079.stdout:1016 read 0x1b0d6ed thru 0x1b13b8d (0x64a1 bytes) 2024-09-21T13:58:36.243 INFO:teuthology.orchestra.run.smithi079.stdout:1019 read 0x75bb1ba thru 0x75c5a2e (0xa875 bytes) 2024-09-21T13:58:36.244 INFO:teuthology.orchestra.run.smithi079.stdout:1020 write 0x6b209ba thru 0x6b2471a (0x3d61 bytes) 2024-09-21T13:58:36.246 INFO:teuthology.orchestra.run.smithi079.stdout:1022 write 0x79900e5 thru 0x799e2d5 (0xe1f1 bytes) 2024-09-21T13:58:36.251 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.251 INFO:teuthology.orchestra.run.smithi079.stdout:1025 writesame 0x905cb27 thru 0x906a2a9 data_size 0x1(0xd783 bytes) 2024-09-21T13:58:36.277 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:36.276+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:36.290 INFO:teuthology.orchestra.run.smithi079.stdout:1026 read 0x30f3b78 thru 0x30f80a4 (0x452d bytes) 2024-09-21T13:58:36.290 INFO:teuthology.orchestra.run.smithi079.stdout:1028 punch from 0xb20f7d8 to 0xb2131c0, (0x39e8 bytes) 2024-09-21T13:58:36.296 INFO:teuthology.orchestra.run.smithi079.stdout:1029 write 0xe0faf3b thru 0xe104795 (0x985b bytes) 2024-09-21T13:58:36.300 INFO:teuthology.orchestra.run.smithi079.stdout:1030 writesame 0xccb8eb6 thru 0xccbc426 data_size 0x1(0x3571 bytes) 2024-09-21T13:58:36.312 INFO:teuthology.orchestra.run.smithi079.stdout:1032 write 0xa1883c5 thru 0xa18e217 (0x5e53 bytes) 2024-09-21T13:58:36.331 INFO:teuthology.orchestra.run.smithi079.stdout:1033 write 0xe8ecdfa thru 0xe8fbc04 (0xee0b bytes) 2024-09-21T13:58:36.338 INFO:teuthology.orchestra.run.smithi079.stdout:1034 read 0xdf7a395 thru 0xdf89c37 (0xf8a3 bytes) 2024-09-21T13:58:36.360 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.360 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.366 INFO:teuthology.orchestra.run.smithi079.stdout:1035 trunc from 0xe8fbc05 to 0x3513c1b 2024-09-21T13:58:36.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:36.377 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:36.375+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:36.426 INFO:teuthology.orchestra.run.smithi079.stdout:1036 writesame 0xa287274 thru 0xa289376 data_size 0x9(0x2103 bytes) 2024-09-21T13:58:36.427 INFO:teuthology.orchestra.run.smithi079.stdout:1037 writesame 0x7415f02 thru 0x7425c59 data_size 0x86(0xfd58 bytes) 2024-09-21T13:58:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:1038 punch from 0x1fa1362 to 0x1fb0eb5, (0xfb53 bytes) 2024-09-21T13:58:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.431 INFO:teuthology.orchestra.run.smithi079.stdout:1041 read 0x1164127 thru 0x1171396 (0xd270 bytes) 2024-09-21T13:58:36.432 INFO:teuthology.orchestra.run.smithi079.stdout:1042 read 0xc9aad1 thru 0xc9df4e (0x347e bytes) 2024-09-21T13:58:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:1044 read 0x1f111f9 thru 0x1f137ea (0x25f2 bytes) 2024-09-21T13:58:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:1045 punch from 0x221d4c3 to 0x2229802, (0xc33f bytes) 2024-09-21T13:58:36.433 INFO:teuthology.orchestra.run.smithi079.stdout:1046 read 0x9b3193a thru 0x9b3a3c7 (0x8a8e bytes) 2024-09-21T13:58:36.434 INFO:teuthology.orchestra.run.smithi079.stdout:1048 write 0x60e781 thru 0x61c2f8 (0xdb78 bytes) 2024-09-21T13:58:36.437 INFO:teuthology.orchestra.run.smithi079.stdout:1049 punch from 0x1a31cbe to 0x1a3d77c, (0xbabe bytes) 2024-09-21T13:58:36.437 INFO:teuthology.orchestra.run.smithi079.stdout:1051 read 0x798d294 thru 0x799a36c (0xd0d9 bytes) 2024-09-21T13:58:36.437 INFO:teuthology.orchestra.run.smithi079.stdout:1052 write 0x59047e thru 0x5910bc (0xc3f bytes) 2024-09-21T13:58:36.467 INFO:teuthology.orchestra.run.smithi079.stdout:1053 writesame 0xc92e3e7 thru 0xc93a700 data_size 0x71(0xc31a bytes) 2024-09-21T13:58:36.467 INFO:teuthology.orchestra.run.smithi079.stdout:1054 write 0xa5fbd31 thru 0xa600f3c (0x520c bytes) 2024-09-21T13:58:36.475 INFO:teuthology.orchestra.run.smithi079.stdout:1055 write 0x9462286 thru 0x946a2d4 (0x804f bytes) 2024-09-21T13:58:36.477 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:36.476+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:36.481 INFO:teuthology.orchestra.run.smithi079.stdout:1056 writesame 0x388db1 thru 0x397b0e data_size 0x17(0xed5e bytes) 2024-09-21T13:58:36.507 INFO:teuthology.orchestra.run.smithi079.stdout:1057 write 0xeb87239 thru 0xeb93607 (0xc3cf bytes) 2024-09-21T13:58:36.515 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.515 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:36.542 INFO:teuthology.orchestra.run.smithi079.stdout:1058 trunc from 0xeb93608 to 0x2c51bad 2024-09-21T13:58:36.574 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.577 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:36.576+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:36.588 INFO:teuthology.orchestra.run.smithi079.stdout:1060 write 0x51d5d85 thru 0x51e5ba0 (0xfe1c bytes) 2024-09-21T13:58:36.605 INFO:teuthology.orchestra.run.smithi079.stdout:1062 writesame 0x6eb6760 thru 0x6ec1d49 data_size 0x5(0xb5ea bytes) 2024-09-21T13:58:36.605 INFO:teuthology.orchestra.run.smithi079.stdout:1064 read 0x1a2a14e thru 0x1a394ba (0xf36d bytes) 2024-09-21T13:58:36.606 INFO:teuthology.orchestra.run.smithi079.stdout:1065 write 0x2737f25 thru 0x2743bc8 (0xbca4 bytes) 2024-09-21T13:58:36.627 INFO:teuthology.orchestra.run.smithi079.stdout:1067 read 0x4208f15 thru 0x420ce92 (0x3f7e bytes) 2024-09-21T13:58:36.627 INFO:teuthology.orchestra.run.smithi079.stdout:1068 read 0x52b7040 thru 0x52bd6db (0x669c bytes) 2024-09-21T13:58:36.627 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.628 INFO:teuthology.orchestra.run.smithi079.stdout:1070 read 0x6a87a4c thru 0x6a8a255 (0x280a bytes) 2024-09-21T13:58:36.628 INFO:teuthology.orchestra.run.smithi079.stdout:1071 punch from 0x62b304c to 0x62b4885, (0x1839 bytes) 2024-09-21T13:58:36.629 INFO:teuthology.orchestra.run.smithi079.stdout:1072 trunc from 0x6ec1d4a to 0x5fa1d50 2024-09-21T13:58:36.646 INFO:teuthology.orchestra.run.smithi079.stdout:1073 read 0x19508d5 thru 0x195257a (0x1ca6 bytes) 2024-09-21T13:58:36.647 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.647 INFO:teuthology.orchestra.run.smithi079.stdout:1076 read 0x445b08c thru 0x445b1b0 (0x125 bytes) 2024-09-21T13:58:36.647 INFO:teuthology.orchestra.run.smithi079.stdout:1077 read 0x1e592e4 thru 0x1e67eb0 (0xebcd bytes) 2024-09-21T13:58:36.648 INFO:teuthology.orchestra.run.smithi079.stdout:1079 read 0x1840fcc thru 0x1845097 (0x40cc bytes) 2024-09-21T13:58:36.649 INFO:teuthology.orchestra.run.smithi079.stdout:1080 write 0x4856393 thru 0x485857f (0x21ed bytes) 2024-09-21T13:58:36.656 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.656 INFO:teuthology.orchestra.run.smithi079.stdout:1083 writesame 0x1d61d94 thru 0x1d6bf28 data_size 0x1(0xa195 bytes) 2024-09-21T13:58:36.670 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.670 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.679 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:36.679+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:36.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:36.704 INFO:teuthology.orchestra.run.smithi079.stdout:1084 trunc from 0x5fa1d50 to 0xb3ece74 2024-09-21T13:58:36.712 INFO:teuthology.orchestra.run.smithi079.stdout:1085 writesame 0x5136bcf thru 0x5139af8 data_size 0x1(0x2f2a bytes) 2024-09-21T13:58:36.718 INFO:teuthology.orchestra.run.smithi079.stdout:1087 read 0x6c5ca82 thru 0x6c5cf2e (0x4ad bytes) 2024-09-21T13:58:36.718 INFO:teuthology.orchestra.run.smithi079.stdout:1088 read 0x96bdfd9 thru 0x96ca749 (0xc771 bytes) 2024-09-21T13:58:36.719 INFO:teuthology.orchestra.run.smithi079.stdout:1090 punch from 0x9b51db6 to 0x9b5e03c, (0xc286 bytes) 2024-09-21T13:58:36.722 INFO:teuthology.orchestra.run.smithi079.stdout:1092 trunc from 0xb3ece74 to 0xd93c36b 2024-09-21T13:58:36.730 INFO:teuthology.orchestra.run.smithi079.stdout:1093 write 0x73ac8bb thru 0x73b8c1a (0xc360 bytes) 2024-09-21T13:58:36.737 INFO:teuthology.orchestra.run.smithi079.stdout:1094 read 0xb636b4a thru 0xb63d9b7 (0x6e6e bytes) 2024-09-21T13:58:36.748 INFO:teuthology.orchestra.run.smithi079.stdout:1095 trunc from 0xd93c36b to 0x67d59c9 2024-09-21T13:58:36.776 INFO:teuthology.orchestra.run.smithi079.stdout:1096 trunc from 0x67d59c9 to 0xb54d87c 2024-09-21T13:58:36.779 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:36.776+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:36.792 INFO:teuthology.orchestra.run.smithi079.stdout:1097 trunc from 0xb54d87c to 0xcb9f317 2024-09-21T13:58:36.802 INFO:teuthology.orchestra.run.smithi079.stdout:1098 read 0xdd4e10 thru 0xde0686 (0xb877 bytes) 2024-09-21T13:58:36.804 INFO:teuthology.orchestra.run.smithi079.stdout:1099 write 0xa034867 thru 0xa03d954 (0x90ee bytes) 2024-09-21T13:58:36.810 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.811 INFO:teuthology.orchestra.run.smithi079.stdout:1104 read 0x38d94a9 thru 0x38dbe31 (0x2989 bytes) 2024-09-21T13:58:36.811 INFO:teuthology.orchestra.run.smithi079.stdout:1105 read 0x3030520 thru 0x3036b5e (0x663f bytes) 2024-09-21T13:58:36.811 INFO:teuthology.orchestra.run.smithi079.stdout:1106 writesame 0xa85b7d3 thru 0xa865b65 data_size 0x43(0xa393 bytes) 2024-09-21T13:58:36.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:36.819 INFO:teuthology.orchestra.run.smithi079.stdout:1107 read 0xa030423 thru 0xa03eed7 (0xeab5 bytes) 2024-09-21T13:58:36.820 INFO:teuthology.orchestra.run.smithi079.stdout:1108 punch from 0x2975966 to 0x2980e34, (0xb4ce bytes) 2024-09-21T13:58:36.821 INFO:teuthology.orchestra.run.smithi079.stdout:1109 write 0x4b74d8b thru 0x4b78d9c (0x4012 bytes) 2024-09-21T13:58:36.827 INFO:teuthology.orchestra.run.smithi079.stdout:1110 writesame 0x79d7cbe thru 0x79dd1e4 data_size 0x1(0x5527 bytes) 2024-09-21T13:58:36.836 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:36.836 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:36.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:36.871 INFO:teuthology.orchestra.run.smithi079.stdout:1112 write 0xe01590c thru 0xe01e583 (0x8c78 bytes) 2024-09-21T13:58:36.877 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.877 INFO:teuthology.orchestra.run.smithi079.stdout:1115 write 0x2cf98a1 thru 0x2cffaf2 (0x6252 bytes) 2024-09-21T13:58:36.880 INFO:teuthology.orchestra.run.smithi079.stdout:1118 writesame 0x83816b4 thru 0x838c30b data_size 0x14(0xac58 bytes) 2024-09-21T13:58:36.880 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:36.879+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:36.885 INFO:teuthology.orchestra.run.smithi079.stdout:1120 punch from 0x9589c0d to 0x9598d6d, (0xf160 bytes) 2024-09-21T13:58:36.885 INFO:teuthology.orchestra.run.smithi079.stdout:1121 read 0x13c7f0c thru 0x13cb106 (0x31fb bytes) 2024-09-21T13:58:36.904 INFO:teuthology.orchestra.run.smithi079.stdout:1122 trunc from 0xe01e584 to 0x115fd4e 2024-09-21T13:58:36.965 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:36.966 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:36.971 INFO:teuthology.orchestra.run.smithi079.stdout:1123 write 0x2932e6a thru 0x293f1e1 (0xc378 bytes) 2024-09-21T13:58:36.976 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:36.977 INFO:teuthology.orchestra.run.smithi079.stdout:1127 read 0x131a47e thru 0x131e550 (0x40d3 bytes) 2024-09-21T13:58:36.977 INFO:teuthology.orchestra.run.smithi079.stdout:1128 read 0x1e4ccd7 thru 0x1e55d0b (0x9035 bytes) 2024-09-21T13:58:36.977 INFO:teuthology.orchestra.run.smithi079.stdout:1130 punch from 0x2778143 to 0x2785c87, (0xdb44 bytes) 2024-09-21T13:58:36.981 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:36.979+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:36.984 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:36.990 INFO:teuthology.orchestra.run.smithi079.stdout:1131 trunc from 0x293f1e2 to 0xb579bb6 2024-09-21T13:58:36.996 INFO:teuthology.orchestra.run.smithi079.stdout:1132 punch from 0x46050a7 to 0x460f0cd, (0xa026 bytes) 2024-09-21T13:58:37.001 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.001 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:37.001 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:37.001 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:37.003 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:37.004 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:37.004 INFO:teuthology.orchestra.run.smithi079.stdout:1133 writesame 0xbad5422 thru 0xbade305 data_size 0x1(0x8ee4 bytes) 2024-09-21T13:58:37.004 INFO:teuthology.orchestra.run.smithi079.stdout:1134 writesame 0x2f86229 thru 0x2f94f7a data_size 0x25(0xed52 bytes) 2024-09-21T13:58:37.011 INFO:teuthology.orchestra.run.smithi079.stdout:1135 write 0x5d6e085 thru 0x5d742e9 (0x6265 bytes) 2024-09-21T13:58:37.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:37.017 INFO:teuthology.orchestra.run.smithi079.stdout:1137 punch from 0x55d7f1e to 0x55dbb2f, (0x3c11 bytes) 2024-09-21T13:58:37.017 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:37.021 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:37.021 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:37.021 INFO:teuthology.orchestra.run.smithi079.stdout:1139 trunc from 0xbade306 to 0x85d5f53 2024-09-21T13:58:37.029 INFO:teuthology.orchestra.run.smithi079.stdout:1140 read 0x381f45e thru 0x3828a9e (0x9641 bytes) 2024-09-21T13:58:37.030 INFO:teuthology.orchestra.run.smithi079.stdout:1141 punch from 0x5a6ec33 to 0x5a788ea, (0x9cb7 bytes) 2024-09-21T13:58:37.030 INFO:teuthology.orchestra.run.smithi079.stdout:1142 clone 6 order 25 su 1048576 sc 8 2024-09-21T13:58:37.043 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:37.063 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:37.063 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:37.082 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:37.083+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:37.093 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:37.094 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:37.123 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:37.123 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:37.146 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.147 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:37.147 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:37.147 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:37.147 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:37.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:37.183 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:37.180+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:37.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:58:37.310 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:37.311+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.4910180000000004, 2024-09-21T13:58:37.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:58:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:58:37.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.3509945600000002, 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:58:37.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:58:37.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.3227355549999995, 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:58:37.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4256270100000004, 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:58:37.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4255655410000001, 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:37.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4173947909999995, 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:58:37.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.416501566, 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.359 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:37.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4164438060000002, 2024-09-21T13:58:37.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:58:37.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4164252140000002, 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:58:37.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:58:37.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4164128759999999, 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:37.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.41639114, 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:37.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:58:37.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4163679570000003, 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:37.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:58:37.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:58:37.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4163475280000002, 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4163327299999997, 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.400 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4163081460000004, 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:58:37.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:37.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:58:37.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4162914500000001, 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:58:37.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4162692129999996, 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.413 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:58:37.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.414 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:58:37.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.4979809099999999, 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:58:37.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:58:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.3284623619999998, 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:58:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:58:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.965223768, 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:58:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:58:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.437 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:37.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:37.439 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone5 from 0x85d5f53 (overlap 0x115fd4e) to 0xfa30c6 2024-09-21T13:58:37.441 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:37.440+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:37.539 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:37.536+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:37.603 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.603 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:37.603 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:37.603 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:37.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:37.639 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:37.636+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:37.645 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-21T13:58:37.682 INFO:teuthology.orchestra.run.smithi079.stdout:1143 read 0x13c7590 thru 0x13cd6b8 (0x6129 bytes) 2024-09-21T13:58:37.683 INFO:teuthology.orchestra.run.smithi079.stdout:1144 read 0x7c33a6e thru 0x7c3b038 (0x75cb bytes) 2024-09-21T13:58:37.709 INFO:teuthology.orchestra.run.smithi079.stdout:1145 write 0xd4c6201 thru 0xd4d1bce (0xb9ce bytes) 2024-09-21T13:58:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:1146 writesame 0x7cd3203 thru 0x7ce1f1e data_size 0x32(0xed1c bytes) 2024-09-21T13:58:37.733 INFO:teuthology.orchestra.run.smithi079.stdout:1148 read 0x554cb60 thru 0x55543b2 (0x7853 bytes) 2024-09-21T13:58:37.733 INFO:teuthology.orchestra.run.smithi079.stdout:1151 read 0x8cd853d thru 0x8ce1931 (0x93f5 bytes) 2024-09-21T13:58:37.733 INFO:teuthology.orchestra.run.smithi079.stdout:1152 write 0xd965dc thru 0xd9917f (0x2ba4 bytes) 2024-09-21T13:58:37.741 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:37.740+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:37.745 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.745 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:37.745 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:37.745 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:37.746 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:37.748 INFO:teuthology.orchestra.run.smithi079.stdout:1153 write 0x484fd54 thru 0x485afd7 (0xb284 bytes) 2024-09-21T13:58:37.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:37.768 INFO:teuthology.orchestra.run.smithi079.stdout:1154 write 0x394c98e thru 0x3955a9b (0x910e bytes) 2024-09-21T13:58:37.790 INFO:teuthology.orchestra.run.smithi079.stdout:1155 writesame 0x20bd5db thru 0x20c42ff data_size 0x1(0x6d25 bytes) 2024-09-21T13:58:37.802 INFO:teuthology.orchestra.run.smithi079.stdout:1156 write 0x2d40ab5 thru 0x2d4e67d (0xdbc9 bytes) 2024-09-21T13:58:37.806 INFO:teuthology.orchestra.run.smithi079.stdout:1158 write 0x4d038d1 thru 0x4d12a39 (0xf169 bytes) 2024-09-21T13:58:37.809 INFO:teuthology.orchestra.run.smithi079.stdout:1161 writesame 0xd090ac4 thru 0xd09e53b data_size 0x4(0xda78 bytes) 2024-09-21T13:58:37.817 INFO:teuthology.orchestra.run.smithi079.stdout:1162 trunc from 0xd4d1bcf to 0xe87c84b 2024-09-21T13:58:37.842 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:37.843+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:37.848 INFO:teuthology.orchestra.run.smithi079.stdout:1164 trunc from 0xe87c84b to 0xf4dbd0 2024-09-21T13:58:37.911 INFO:teuthology.orchestra.run.smithi079.stdout:1165 write 0xc9dab4b thru 0xc9e5591 (0xaa47 bytes) 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:861 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'171, mlcod=29'167)", 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:37.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4577494120000001, 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002361892, 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468087+0000", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468105+0000", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7595e-05 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468115+0000", 2024-09-21T13:58:37.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0902e-05 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468124+0000", 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2819999999999996e-06 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468197+0000", 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468232+0000", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4703000000000003e-05 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470415+0000", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021829739999999999 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470450+0000", 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4885000000000002e-05 2024-09-21T13:58:37.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:912 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'185, mlcod=29'183)", 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3021907129999999, 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020263149999999999, 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623645+0000", 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623657+0000", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2257e-05 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623679+0000", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1957e-05 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623689+0000", 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623796+0000", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107624 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623853+0000", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6849999999999999e-05 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625607+0000", 2024-09-21T13:58:37.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017542600000000001 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625673+0000", 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5386e-05 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:922 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'189, mlcod=29'187)", 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.2555439390000007, 2024-09-21T13:58:37.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025362470000000002, 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670291+0000", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670307+0000", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6393e-05 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670340+0000", 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2897e-05 2024-09-21T13:58:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670354+0000", 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.42e-05 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670473+0000", 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119172 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670511+0000", 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7466999999999999e-05 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672732+0000", 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002220816 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672829+0000", 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7656000000000001e-05 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:932 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'192, mlcod=29'189)", 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.2427977370000001, 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020005800000000001, 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683039+0000", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683038+0000", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683048+0000", 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3530000000000001e-06 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683063+0000", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4932e-05 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683071+0000", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0539999999999995e-06 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683162+0000", 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1244999999999998e-05 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.683185+0000", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3328000000000001e-05 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.685012+0000", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001826933 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.685040+0000", 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7820000000000001e-05 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1048 3.4 e29/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 29'221, mlcod=29'218)", 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7972426769999998, 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033734450000000001, 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128593+0000", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128602+0000", 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:37.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128630+0000", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7260999999999999e-05 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128641+0000", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0994e-05 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128692+0000", 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1793999999999999e-05 2024-09-21T13:58:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128722+0000", 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9870999999999999e-05 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131932+0000", 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032095729999999999 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131968+0000", 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6031000000000001e-05 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1083 3.4 e30/23 3:27acbb70:::rbd_data.1185e8851f1.0000000000000025:head v 30'229, mlcod=29'225)", 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6942362479999993, 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002238987, 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231600+0000", 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231605+0000", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.481e-06 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231614+0000", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4069999999999999e-06 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231620+0000", 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5439999999999998e-06 2024-09-21T13:58:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231686+0000", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6103000000000001e-05 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231723+0000", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6770000000000002e-05 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233790+0000", 2024-09-21T13:58:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020677730000000002 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233840+0000", 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9447000000000003e-05 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1085 3.4 e30/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 30'230, mlcod=30'227)", 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6930129790000006, 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028868180000000002, 2024-09-21T13:58:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232823+0000", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232834+0000", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0621e-05 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232852+0000", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8546000000000002e-05 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232880+0000", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7421999999999999e-05 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232945+0000", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5514999999999999e-05 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232980+0000", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5070000000000001e-05 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235681+0000", 2024-09-21T13:58:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027004450000000001 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235711+0000", 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0318999999999999e-05 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1086 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'231, mlcod=30'228)", 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6909507710000007, 2024-09-21T13:58:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002857708, 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234885+0000", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234895+0000", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7450000000000007e-06 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234913+0000", 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.753e-05 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234922+0000", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5470000000000002e-06 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234966+0000", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3582999999999999e-05 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234983+0000", 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7149000000000001e-05 2024-09-21T13:58:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237710+0000", 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027272849999999999 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237744+0000", 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3964000000000002e-05 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1087 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'232, mlcod=30'228)", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6898006540000008, 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003476987, 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236044+0000", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2700000000000004e-06 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236060+0000", 2024-09-21T13:58:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5739999999999998e-05 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236068+0000", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4430000000000003e-06 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236103+0000", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4428000000000003e-05 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236121+0000", 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8099999999999999e-05 2024-09-21T13:58:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239473+0000", 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003352486 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239513+0000", 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0343000000000003e-05 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1088 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'233, mlcod=30'229)", 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6886653270000007, 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002368682, 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237171+0000", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237177+0000", 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2169999999999999e-06 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237192+0000", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.433e-05 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237198+0000", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6699999999999997e-06 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237243+0000", 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4879999999999997e-05 2024-09-21T13:58:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237261+0000", 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7629999999999999e-05 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239517+0000", 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022558729999999998 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239540+0000", 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3822999999999999e-05 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2331 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'295, mlcod=32'293)", 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.6117858030000001, 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019652279999999999, 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314051+0000", 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314058+0000", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9700000000000002e-06 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314077+0000", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9029999999999999e-05 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314085+0000", 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314143+0000", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8535000000000001e-05 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.314162+0000", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8646000000000001e-05 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.315978+0000", 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00181632 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316017+0000", 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8096999999999998e-05 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2332 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'296, mlcod=32'294)", 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.6089770269999999, 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024063629999999999, 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316859+0000", 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316866+0000", 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8240000000000002e-06 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316877+0000", 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1143e-05 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316885+0000", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8720000000000002e-06 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316923+0000", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8092000000000001e-05 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316937+0000", 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3395e-05 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319238+0000", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023008730000000002 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319266+0000", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8911000000000002e-05 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2347 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'298, mlcod=33'296)", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5944197449999997, 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001993383, 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331417+0000", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331424+0000", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6029999999999999e-06 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331440+0000", 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5522000000000001e-05 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331448+0000", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5140000000000001e-06 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331490+0000", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1603999999999997e-05 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.331511+0000", 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1274999999999999e-05 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.333375+0000", 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00186371 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.333411+0000", 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5942999999999998e-05 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2618 3.0 e33/23 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.0888143379999997, 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038473650000000002, 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837020+0000", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837040+0000", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0369000000000001e-05 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837084+0000", 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3754000000000002e-05 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837107+0000", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2606e-05 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837225+0000", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118353 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837267+0000", 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2116000000000001e-05 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840831+0000", 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035635390000000001 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840870+0000", 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9304000000000002e-05 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2617 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.0878465410000002, 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034007360000000001, 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837990+0000", 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837998+0000", 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3310000000000004e-06 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838012+0000", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3703000000000001e-05 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838019+0000", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3679999999999996e-06 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838108+0000", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9285999999999999e-05 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838154+0000", 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5726999999999998e-05 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841324+0000", 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003170094 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841391+0000", 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7273000000000005e-05 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2638 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'24, mlcod=33'22)", 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.0583289300000001, 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031467190000000001, 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867507+0000", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867527+0000", 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867540+0000", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3434999999999999e-05 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867548+0000", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9039999999999992e-06 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867804+0000", 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000255839 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867847+0000", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2883999999999998e-05 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870565+0000", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027180889999999999 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870655+0000", 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0032999999999997e-05 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3521 3.9 e33/23 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head v 33'25, mlcod=33'23)", 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9651754639999996, 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056663929999999996, 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960646+0000", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999847 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963517+0000", 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028708319999999998 2024-09-21T13:58:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963538+0000", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0809999999999999e-05 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963547+0000", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963602+0000", 2024-09-21T13:58:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5047000000000003e-05 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963622+0000", 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0227000000000001e-05 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966242+0000", 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026194790000000001 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966328+0000", 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6526000000000005e-05 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3564 3.4 e33/23 3:22fd9022:::rbd_data.1185e0e4cd61.0000000000000026:head v 33'309, mlcod=33'307)", 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8664605539999997, 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035435229999999998, 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059375+0000", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059453+0000", 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7869999999999998e-05 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059486+0000", 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3389000000000002e-05 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059505+0000", 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8686999999999999e-05 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059569+0000", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4033000000000002e-05 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059599+0000", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9895000000000001e-05 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062879+0000", 2024-09-21T13:58:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032800080000000001 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062920+0000", 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1467999999999997e-05 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3911 3.9 e33/23 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head v 33'35, mlcod=33'33)", 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.0958508040000003, 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021728120000000001, 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829985+0000", 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829996+0000", 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0608000000000001e-05 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830015+0000", 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9045000000000001e-05 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830026+0000", 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1291000000000001e-05 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830148+0000", 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121705 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830211+0000", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3132999999999993e-05 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.832111+0000", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001900103 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.832159+0000", 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8270999999999999e-05 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:7088 3.0 e35/23 3:05b35069:::rbd_data.11853c86949e.0000000000000007:head v 35'41, mlcod=34'39)", 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.055158066999999998, 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021232870000000002, 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870678+0000", 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871210+0000", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00053213700000000002 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871231+0000", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1518e-05 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871240+0000", 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871296+0000", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6603e-05 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871323+0000", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7019999999999999e-05 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.872740+0000", 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001416346 2024-09-21T13:58:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.872802+0000", 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2694000000000007e-05 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.012 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:38.013 INFO:teuthology.orchestra.run.smithi079.stdout:1166 trunc from 0xc9e5592 to 0xa4cfa4 2024-09-21T13:58:38.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:38.015 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.015 INFO:teuthology.orchestra.run.smithi079.stdout:1168 write 0xb9264d3 thru 0xb931334 (0xae62 bytes) 2024-09-21T13:58:38.015 INFO:teuthology.orchestra.run.smithi079.stdout:1170 read 0xcfd515 thru 0xd056e0 (0x81cc bytes) 2024-09-21T13:58:38.015 INFO:teuthology.orchestra.run.smithi079.stdout:1172 trunc from 0xb931335 to 0x1aec1da 2024-09-21T13:58:38.015 INFO:teuthology.orchestra.run.smithi079.stdout:1173 read 0x789466 thru 0x789ac1 (0x65c bytes) 2024-09-21T13:58:38.015 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:38.011+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:38.033 INFO:teuthology.orchestra.run.smithi079.stdout:1175 trunc from 0x1aec1da to 0xcf158b7 2024-09-21T13:58:38.043 INFO:teuthology.orchestra.run.smithi079.stdout:1176 read 0xb31da04 thru 0xb32b5b8 (0xdbb5 bytes) 2024-09-21T13:58:38.043 INFO:teuthology.orchestra.run.smithi079.stdout:1177 read 0x2e40bf0 thru 0x2e443af (0x37c0 bytes) 2024-09-21T13:58:38.044 INFO:teuthology.orchestra.run.smithi079.stdout:1179 writesame 0x68dc251 thru 0x68e0593 data_size 0x1(0x4343 bytes) 2024-09-21T13:58:38.063 INFO:teuthology.orchestra.run.smithi079.stdout:1181 read 0x866d0c1 thru 0x866de2d (0xd6d bytes) 2024-09-21T13:58:38.064 INFO:teuthology.orchestra.run.smithi079.stdout:1182 writesame 0x92e91d2 thru 0x92f1fe9 data_size 0x4(0x8e18 bytes) 2024-09-21T13:58:38.077 INFO:teuthology.orchestra.run.smithi079.stdout:1183 write 0xab67d19 thru 0xab6abf8 (0x2ee0 bytes) 2024-09-21T13:58:38.086 INFO:teuthology.orchestra.run.smithi079.stdout:1184 trunc from 0xcf158b7 to 0xa3100b6 2024-09-21T13:58:38.110 INFO:teuthology.orchestra.run.smithi079.stdout:1185 write 0xb439f01 thru 0xb439f8b (0x8b bytes) 2024-09-21T13:58:38.113 INFO:teuthology.orchestra.run.smithi079.stdout:1186 punch from 0xa193b57 to 0xa1a2347, (0xe7f0 bytes) 2024-09-21T13:58:38.114 INFO:teuthology.orchestra.run.smithi079.stdout:1187 trunc from 0xb439f8c to 0xa8e3ccb 2024-09-21T13:58:38.114 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:38.112+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:38.125 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.127 INFO:teuthology.orchestra.run.smithi079.stdout:1189 trunc from 0xa8e3ccb to 0xb881df1 2024-09-21T13:58:38.151 INFO:teuthology.orchestra.run.smithi079.stdout:1190 trunc from 0xb881df1 to 0x17633a3 2024-09-21T13:58:38.175 INFO:teuthology.orchestra.run.smithi079.stdout:1191 write 0x2f284a2 thru 0x2f326aa (0xa209 bytes) 2024-09-21T13:58:38.179 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:38.179 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:38.179 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:38.180 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:38.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:38.203 INFO:teuthology.orchestra.run.smithi079.stdout:1192 write 0xdba2a4b thru 0xdbb0a04 (0xdfba bytes) 2024-09-21T13:58:38.206 INFO:teuthology.orchestra.run.smithi079.stdout:1193 punch from 0xcb91ceb to 0xcb9e7a9, (0xcabe bytes) 2024-09-21T13:58:38.206 INFO:teuthology.orchestra.run.smithi079.stdout:1195 writesame 0x52a8ebf thru 0x52b3ec5 data_size 0x9(0xb007 bytes) 2024-09-21T13:58:38.215 INFO:teuthology.orchestra.run.smithi079.stdout:1196 punch from 0x90d581e to 0x90d6b52, (0x1334 bytes) 2024-09-21T13:58:38.215 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.215 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.215 INFO:teuthology.orchestra.run.smithi079.stdout:1200 read 0x240e697 thru 0x241c303 (0xdc6d bytes) 2024-09-21T13:58:38.215 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:38.212+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:38.215 INFO:teuthology.orchestra.run.smithi079.stdout:1201 read 0xa7826c thru 0xa80ad2 (0x8867 bytes) 2024-09-21T13:58:38.216 INFO:teuthology.orchestra.run.smithi079.stdout:1203 write 0x1dca7a0 thru 0x1dd2cf4 (0x8555 bytes) 2024-09-21T13:58:38.219 INFO:teuthology.orchestra.run.smithi079.stdout:1204 punch from 0x2733334 to 0x273efbc, (0xbc88 bytes) 2024-09-21T13:58:38.219 INFO:teuthology.orchestra.run.smithi079.stdout:1205 writesame 0x46f73a6 thru 0x4702a9e data_size 0x1(0xb6f9 bytes) 2024-09-21T13:58:38.250 INFO:teuthology.orchestra.run.smithi079.stdout:1206 trunc from 0xdbb0a05 to 0x7f0ea1b 2024-09-21T13:58:38.253 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:58:38.270 INFO:teuthology.orchestra.run.smithi079.stdout:1208 write 0x3831a8f thru 0x383deb3 (0xc425 bytes) 2024-09-21T13:58:38.272 INFO:teuthology.orchestra.run.smithi079.stdout:1209 read 0x7a46261 thru 0x7a4bda8 (0x5b48 bytes) 2024-09-21T13:58:38.272 INFO:teuthology.orchestra.run.smithi079.stdout:1210 write 0x155c80a thru 0x1564631 (0x7e28 bytes) 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:1216 punch from 0x17b7465 to 0x17bb35f, (0x3efa bytes) 2024-09-21T13:58:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:1218 write 0x5c00b94 thru 0x5c0be2a (0xb297 bytes) 2024-09-21T13:58:38.295 INFO:teuthology.orchestra.run.smithi079.stdout:1219 writesame 0xdb64f7b thru 0xdb65cda data_size 0x10(0xd60 bytes) 2024-09-21T13:58:38.297 INFO:teuthology.orchestra.run.smithi079.stdout:1220 read 0xd39a3e7 thru 0xd3a53df (0xaff9 bytes) 2024-09-21T13:58:38.306 INFO:teuthology.orchestra.run.smithi079.stdout:1221 writesame 0xde723e7 thru 0xde81a3f data_size 0x1(0xf659 bytes) 2024-09-21T13:58:38.307 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.315 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:38.312+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:38.316 INFO:teuthology.orchestra.run.smithi079.stdout:1223 write 0xe322a9a thru 0xe3252bd (0x2824 bytes) 2024-09-21T13:58:38.328 INFO:teuthology.orchestra.run.smithi079.stdout:1224 trunc from 0xe3252be to 0x79b57a2 2024-09-21T13:58:38.332 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:38.332 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:38.333 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:38.333 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:38.340 INFO:teuthology.orchestra.run.smithi079.stdout:1225 write 0x33cd630 thru 0x33d1898 (0x4269 bytes) 2024-09-21T13:58:38.343 INFO:teuthology.orchestra.run.smithi079.stdout:1227 read 0x26e10a1 thru 0x26ec6af (0xb60f bytes) 2024-09-21T13:58:38.344 INFO:teuthology.orchestra.run.smithi079.stdout:1228 writesame 0x3332e92 thru 0x3341ae5 data_size 0x7d(0xec54 bytes) 2024-09-21T13:58:38.347 INFO:teuthology.orchestra.run.smithi079.stdout:1230 read 0x5eb24c thru 0x5fae16 (0xfbcb bytes) 2024-09-21T13:58:38.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:38.349 INFO:teuthology.orchestra.run.smithi079.stdout:1231 read 0x1f899aa thru 0x1f9342a (0x9a81 bytes) 2024-09-21T13:58:38.349 INFO:teuthology.orchestra.run.smithi079.stdout:1232 read 0x4cf8d73 thru 0x4d04824 (0xbab2 bytes) 2024-09-21T13:58:38.350 INFO:teuthology.orchestra.run.smithi079.stdout:1233 read 0x75d3570 thru 0x75d816d (0x4bfe bytes) 2024-09-21T13:58:38.350 INFO:teuthology.orchestra.run.smithi079.stdout:1234 write 0xf68989 thru 0xf70fdc (0x8654 bytes) 2024-09-21T13:58:38.371 INFO:teuthology.orchestra.run.smithi079.stdout:1235 writesame 0xe9ffd83 thru 0xea0cdc8 data_size 0x1(0xd046 bytes) 2024-09-21T13:58:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:1237 punch from 0x5efaa1b to 0x5f066ba, (0xbc9f bytes) 2024-09-21T13:58:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:1238 punch from 0x3f197b2 to 0x3f2659d, (0xcdeb bytes) 2024-09-21T13:58:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:1239 punch from 0x520ba9f to 0x521aff5, (0xf556 bytes) 2024-09-21T13:58:38.374 INFO:teuthology.orchestra.run.smithi079.stdout:1240 read 0x2e160ff thru 0x2e20676 (0xa578 bytes) 2024-09-21T13:58:38.383 INFO:teuthology.orchestra.run.smithi079.stdout:1241 trunc from 0xea0cdc9 to 0x8fe483e 2024-09-21T13:58:38.409 INFO:teuthology.orchestra.run.smithi079.stdout:1242 write 0xbe1560a thru 0xbe1d621 (0x8018 bytes) 2024-09-21T13:58:38.411 INFO:teuthology.orchestra.run.smithi079.stdout:1244 read 0x31f71cb thru 0x320519f (0xdfd5 bytes) 2024-09-21T13:58:38.412 INFO:teuthology.orchestra.run.smithi079.stdout:1246 write 0x3ba8720 thru 0x3bb57cb (0xd0ac bytes) 2024-09-21T13:58:38.415 INFO:teuthology.orchestra.run.smithi079.stdout:1247 punch from 0xa62f0f1 to 0xa634c08, (0x5b17 bytes) 2024-09-21T13:58:38.415 INFO:teuthology.orchestra.run.smithi079.stdout:1248 write 0x554efb1 thru 0x55583a6 (0x93f6 bytes) 2024-09-21T13:58:38.416 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:38.412+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:38.419 INFO:teuthology.orchestra.run.smithi079.stdout:1250 writesame 0xad798cb thru 0xad80f42 data_size 0x22(0x7678 bytes) 2024-09-21T13:58:38.423 INFO:teuthology.orchestra.run.smithi079.stdout:1251 trunc from 0xbe1d622 to 0xbfffebd 2024-09-21T13:58:38.431 INFO:teuthology.orchestra.run.smithi079.stdout:1252 read 0x4ee050 thru 0x4f6e8c (0x8e3d bytes) 2024-09-21T13:58:38.432 INFO:teuthology.orchestra.run.smithi079.stdout:1254 write 0x4ed83c5 thru 0x4ede7ca (0x6406 bytes) 2024-09-21T13:58:38.446 INFO:teuthology.orchestra.run.smithi079.stdout:1255 write 0xde208d1 thru 0xde2c94c (0xc07c bytes) 2024-09-21T13:58:38.448 INFO:teuthology.orchestra.run.smithi079.stdout:1256 read 0x6b3a721 thru 0x6b481fd (0xdadd bytes) 2024-09-21T13:58:38.448 INFO:teuthology.orchestra.run.smithi079.stdout:1257 write 0x2171dca thru 0x217f640 (0xd877 bytes) 2024-09-21T13:58:38.451 INFO:teuthology.orchestra.run.smithi079.stdout:1258 punch from 0x4236f6 to 0x42c6c3, (0x8fcd bytes) 2024-09-21T13:58:38.451 INFO:teuthology.orchestra.run.smithi079.stdout:1259 write 0x5f6b833 thru 0x5f72ebf (0x768d bytes) 2024-09-21T13:58:38.453 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.453 INFO:teuthology.orchestra.run.smithi079.stdout:1262 read 0x67869b6 thru 0x679339b (0xc9e6 bytes) 2024-09-21T13:58:38.458 INFO:teuthology.orchestra.run.smithi079.stdout:1263 trunc from 0xde2c94d to 0xacb58aa 2024-09-21T13:58:38.473 INFO:teuthology.orchestra.run.smithi079.stdout:1264 punch from 0xab5724 to 0xabc87d, (0x7159 bytes) 2024-09-21T13:58:38.474 INFO:teuthology.orchestra.run.smithi079.stdout:1265 trunc from 0xacb58aa to 0xb26fea5 2024-09-21T13:58:38.478 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:892 3.8 3:12eebb35:::rbd_data.1185e8851f1.000000000000004c:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.9502369159999997, 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020018940999999998, 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 892 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529205+0000", 2024-09-21T13:58:38.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529203+0000", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529218+0000", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4752999999999999e-05 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529248+0000", 2024-09-21T13:58:38.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0243000000000002e-05 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529263+0000", 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5133000000000001e-05 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529338+0000", 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5007999999999997e-05 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.529518+0000", 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000179746 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.533389+0000", 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038712059999999999 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549140+0000", 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015751304000000001 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549151+0000", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0934000000000001e-05 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549192+0000", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0432999999999997e-05 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.549224+0000", 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2724e-05 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.484 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2578 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7148314449999997, 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012623001, 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2578 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764611+0000", 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764610+0000", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764617+0000", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764629+0000", 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1481000000000001e-05 2024-09-21T13:58:38.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764637+0000", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0930000000000003e-06 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.770932+0000", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062953649999999998 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771018+0000", 2024-09-21T13:58:38.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5124999999999996e-05 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771397+0000", 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037906700000000002 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.773596+0000", 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002199201 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777182+0000", 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035860750000000002 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777211+0000", 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9600000000000001e-05 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.777234+0000", 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2306999999999998e-05 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2579 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.71475606, 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01507579, 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2579 2024-09-21T13:58:38.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764686+0000", 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764685+0000", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764691+0000", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4670000000000003e-06 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764700+0000", 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8430000000000005e-06 2024-09-21T13:58:38.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.764708+0000", 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1899999999999998e-06 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771834+0000", 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071266250000000001 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.771900+0000", 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5405000000000001e-05 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.772103+0000", 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000203816 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.773604+0000", 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001500953 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779710+0000", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006105376 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779741+0000", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1053999999999998e-05 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.779762+0000", 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1094000000000002e-05 2024-09-21T13:58:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2678 3.18 3:189e6eaa:::rbd_data.11854cc47015.0000000000000061:7 [read 163840~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.6003801769999999, 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017838525000000001, 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2678 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879062+0000", 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879061+0000", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879067+0000", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.703e-06 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879083+0000", 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5909999999999998e-05 2024-09-21T13:58:38.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.879096+0000", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.289e-05 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.882617+0000", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035206669999999999 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.882768+0000", 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015083100000000001 2024-09-21T13:58:38.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.896901+0000", 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014132831 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2927 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 458752~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5934037730000004, 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012443088, 2024-09-21T13:58:38.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2927 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886038+0000", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886042+0000", 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7650000000000001e-06 2024-09-21T13:58:38.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886056+0000", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3682e-05 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886066+0000", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6830000000000003e-06 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898045+0000", 2024-09-21T13:58:38.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011979049 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898254+0000", 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000208784 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898482+0000", 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022792999999999999 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2928 3.8 3:149d04ad:::rbd_data.1185e8851f1.0000000000000004:5 [read 491520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5933674939999998, 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013336162, 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2928 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886075+0000", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886074+0000", 2024-09-21T13:58:38.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886079+0000", 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7620000000000003e-06 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886092+0000", 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3329999999999999e-05 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886102+0000", 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0044000000000001e-05 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898618+0000", 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012515849000000001 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.898785+0000", 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016707700000000001 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899411+0000", 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000626094 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2930 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5933306060000003, 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013379779, 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2930 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886112+0000", 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886111+0000", 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886116+0000", 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9570000000000001e-06 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886129+0000", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3424999999999999e-05 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886151+0000", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2073999999999999e-05 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899474+0000", 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013322791 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899491+0000", 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7492000000000001e-05 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2931 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5932812519999997, 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013397617000000001, 2024-09-21T13:58:38.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2931 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886161+0000", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886160+0000", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886165+0000", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8670000000000002e-06 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886179+0000", 2024-09-21T13:58:38.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3706999999999999e-05 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886188+0000", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3200000000000006e-06 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899543+0000", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013354662 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899559+0000", 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5970000000000001e-05 2024-09-21T13:58:38.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2932 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5932433770000003, 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013487984, 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2932 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886199+0000", 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886198+0000", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886203+0000", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7500000000000003e-06 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886216+0000", 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.886984+0000", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076842000000000002 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899668+0000", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012684436 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899687+0000", 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8456000000000001e-05 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2933 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5924384849999997, 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012806563, 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2933 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887004+0000", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887002+0000", 2024-09-21T13:58:38.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887044+0000", 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1810000000000001e-05 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887065+0000", 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0809999999999999e-05 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887080+0000", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4832e-05 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899793+0000", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012712864000000001 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899810+0000", 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7665000000000001e-05 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.525 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2977 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5923497659999999, 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012787886, 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2977 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887092+0000", 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887091+0000", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887097+0000", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9039999999999997e-06 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887112+0000", 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5159e-05 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887124+0000", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1304999999999999e-05 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899864+0000", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012740227 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899880+0000", 2024-09-21T13:58:38.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6351999999999999e-05 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:2978 3.8 3.b520b928 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5923085710000002, 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012812085000000001, 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 2978 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887134+0000", 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.887133+0000", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888480+0000", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001347067 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888499+0000", 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9122000000000001e-05 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.888513+0000", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4295e-05 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899930+0000", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011416397999999999 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.899946+0000", 2024-09-21T13:58:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6135999999999999e-05 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3511 3.7 3:e0f17847:::rbd_data.1185e0e4cd61.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5463210140000001, 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019117536000000001, 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3511 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933121+0000", 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.933120+0000", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934347+0000", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012266390000000001 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934358+0000", 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1223000000000001e-05 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934365+0000", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0260000000000002e-06 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934395+0000", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9481000000000001e-05 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934491+0000", 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6508000000000005e-05 2024-09-21T13:58:38.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934794+0000", 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030285099999999998 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941226+0000", 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064324129999999997 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952151+0000", 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010924476000000001 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952188+0000", 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7045000000000002e-05 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.952239+0000", 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0807999999999999e-05 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3512 3.7 3:e75521fd:::rbd_data.1185e0e4cd61.0000000000000003:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5447934759999997, 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019612041, 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3512 2024-09-21T13:58:38.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934649+0000", 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.934647+0000", 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935627+0000", 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00097970299999999995 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935638+0000", 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1055e-05 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935643+0000", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7690000000000004e-06 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937250+0000", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001607151 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937409+0000", 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000159476 2024-09-21T13:58:38.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.937803+0000", 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000393481 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941245+0000", 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003442498 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954200+0000", 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012955022 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954236+0000", 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5673000000000002e-05 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954261+0000", 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4632000000000001e-05 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3513 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5437930560000002, 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019324754, 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3513 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.546 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935649+0000", 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935648+0000", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935651+0000", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9380000000000001e-06 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935656+0000", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5290000000000002e-06 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.935659+0000", 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.824e-06 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.939409+0000", 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037498789999999998 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.939542+0000", 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013348799999999999 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940068+0000", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00052610500000000002 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942295+0000", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022266719999999999 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954924+0000", 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012629494 2024-09-21T13:58:38.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954954+0000", 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9586000000000001e-05 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.954974+0000", 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.995e-05 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.551 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3515 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5409902649999996, 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016634667999999998, 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3515 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:38.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938452+0000", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938449+0000", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938462+0000", 2024-09-21T13:58:38.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2323999999999999e-05 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938477+0000", 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5308999999999999e-05 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.938488+0000", 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0984e-05 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940547+0000", 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002059291 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940640+0000", 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2429999999999994e-05 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940925+0000", 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028547000000000002 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942656+0000", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017311819999999999 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955015+0000", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012358549 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955054+0000", 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8682e-05 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955087+0000", 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3013999999999999e-05 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3516 3.7 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.5388367130000002, 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014605259000000001, 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3516 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940606+0000", 2024-09-21T13:58:38.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940604+0000", 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940613+0000", 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9339999999999995e-06 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940623+0000", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0713999999999999e-05 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.940636+0000", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2554999999999999e-05 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941272+0000", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00063589699999999996 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941338+0000", 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5949000000000002e-05 2024-09-21T13:58:38.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.941541+0000", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020328100000000001 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.942663+0000", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011223030000000001 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955135+0000", 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012471996000000001 2024-09-21T13:58:38.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955181+0000", 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5865999999999998e-05 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.955211+0000", 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9515000000000001e-05 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:7017 3.1e 3:7cf4ba20:::rbd_data.11853c86949e.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 28074497~47566] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:37.719448+0000", 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.75999416200000003, 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012558167, 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7017 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.719448+0000", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.719448+0000", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.719446+0000", 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721062+0000", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016161579999999999 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721091+0000", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9475000000000002e-05 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721105+0000", 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3881e-05 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721180+0000", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4606999999999999e-05 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721312+0000", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013191200000000001 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.721570+0000", 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025804799999999998 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.727143+0000", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055734130000000002 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.731931+0000", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047879029999999996 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.731974+0000", 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3306999999999997e-05 2024-09-21T13:58:38.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.732006+0000", 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000003e-05 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:7166 3.18 3:1a366bac:::rbd_data.11853c86949e.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:38.047405+0000", 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.43203687699999999, 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018686983000000001, 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7166 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047405+0000", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047405+0000", 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047404+0000", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047411+0000", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3329999999999999e-06 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047424+0000", 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2241e-05 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047430+0000", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047515+0000", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4840999999999996e-05 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.047628+0000", 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011360499999999999 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.051086+0000", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00345765 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.065925+0000", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014838653 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.065945+0000", 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0432999999999999e-05 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.066026+0000", 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0612999999999995e-05 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.066092+0000", 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6779000000000006e-05 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:7264 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T13:58:38.573 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:38.222612+0000", 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.256830371, 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021805529000000001, 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7264 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:38.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222612+0000", 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222612+0000", 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222611+0000", 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222618+0000", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7120000000000003e-06 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222634+0000", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6687000000000001e-05 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222645+0000", 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0393e-05 2024-09-21T13:58:38.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222693+0000", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8553000000000001e-05 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.222843+0000", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000150104 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.226380+0000", 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035366619999999999 2024-09-21T13:58:38.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.244344+0000", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.017963870999999999 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.244353+0000", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1090000000000004e-06 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.244387+0000", 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3865999999999997e-05 2024-09-21T13:58:38.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.244417+0000", 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0549999999999997e-05 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:38.579 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:38.580 INFO:teuthology.orchestra.run.smithi079.stdout:1266 writesame 0xab7515 thru 0xac2e32 data_size 0x23(0xb91e bytes) 2024-09-21T13:58:38.580 INFO:teuthology.orchestra.run.smithi079.stdout:1268 writesame 0x8ec963 thru 0x8f33d5 data_size 0x11(0x6a73 bytes) 2024-09-21T13:58:38.580 INFO:teuthology.orchestra.run.smithi079.stdout:1271 punch from 0x4685bb7 to 0x4686ed9, (0x1322 bytes) 2024-09-21T13:58:38.581 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:38.582 INFO:teuthology.orchestra.run.smithi079.stdout:1274 trunc from 0xb26fea5 to 0x8a2e611 2024-09-21T13:58:38.582 INFO:teuthology.orchestra.run.smithi079.stdout:1275 write 0x8f03352 thru 0x8f0e974 (0xb623 bytes) 2024-09-21T13:58:38.582 INFO:teuthology.orchestra.run.smithi079.stdout:1276 write 0xcad58db thru 0xcae0d38 (0xb45e bytes) 2024-09-21T13:58:38.582 INFO:teuthology.orchestra.run.smithi079.stdout:1277 punch from 0x573fb71 to 0x5742c9a, (0x3129 bytes) 2024-09-21T13:58:38.583 INFO:teuthology.orchestra.run.smithi079.stdout:1278 read 0x87850f7 thru 0x878ea14 (0x991e bytes) 2024-09-21T13:58:38.583 INFO:teuthology.orchestra.run.smithi079.stdout:1279 read 0x96e4ed8 thru 0x96ed3ae (0x84d7 bytes) 2024-09-21T13:58:38.583 INFO:teuthology.orchestra.run.smithi079.stdout:1281 read 0x61e76c5 thru 0x61ed64a (0x5f86 bytes) 2024-09-21T13:58:38.583 INFO:teuthology.orchestra.run.smithi079.stdout:1284 trunc from 0xcae0d39 to 0x29172b0 2024-09-21T13:58:38.583 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:38.579+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:38.584 INFO:teuthology.orchestra.run.smithi079.stdout:1285 read 0x279048c thru 0x2791860 (0x13d5 bytes) 2024-09-21T13:58:38.584 INFO:teuthology.orchestra.run.smithi079.stdout:1286 read 0x1bf69fa thru 0x1c05bdf (0xf1e6 bytes) 2024-09-21T13:58:38.585 INFO:teuthology.orchestra.run.smithi079.stdout:1287 punch from 0x1ae08a8 to 0x1aed3ba, (0xcb12 bytes) 2024-09-21T13:58:38.605 INFO:teuthology.orchestra.run.smithi079.stdout:1288 trunc from 0x29172b0 to 0xb425f79 2024-09-21T13:58:38.633 INFO:teuthology.orchestra.run.smithi079.stdout:1289 trunc from 0xb425f79 to 0x41ee302 2024-09-21T13:58:38.649 INFO:teuthology.orchestra.run.smithi079.stdout:1292 punch from 0x2061907 to 0x2063cc6, (0x23bf bytes) 2024-09-21T13:58:38.649 INFO:teuthology.orchestra.run.smithi079.stdout:1294 writesame 0x2b0c3d8 thru 0x2b0fb5c data_size 0x1(0x3785 bytes) 2024-09-21T13:58:38.666 INFO:teuthology.orchestra.run.smithi079.stdout:1296 punch from 0xa30675 to 0xa3eed7, (0xe862 bytes) 2024-09-21T13:58:38.681 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:38.680+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:38.699 INFO:teuthology.orchestra.run.smithi079.stdout:1298 writesame 0xb7c594e thru 0xb7ced26 data_size 0x1(0x93d9 bytes) 2024-09-21T13:58:38.702 INFO:teuthology.orchestra.run.smithi079.stdout:1299 read 0xa471df0 thru 0xa4723fc (0x60d bytes) 2024-09-21T13:58:38.703 INFO:teuthology.orchestra.run.smithi079.stdout:1300 writesame 0x8cbdd4c thru 0x8cc079c data_size 0x17(0x2a51 bytes) 2024-09-21T13:58:38.707 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.707 INFO:teuthology.orchestra.run.smithi079.stdout:1303 writesame 0x1a2ecf3 thru 0x1a3cb0d data_size 0xb(0xde1b bytes) 2024-09-21T13:58:38.717 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:38.717 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:38.717 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:38.717 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:38.724 INFO:teuthology.orchestra.run.smithi079.stdout:1306 trunc from 0xb7ced27 to 0xed240a8 2024-09-21T13:58:38.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:38.738 INFO:teuthology.orchestra.run.smithi079.stdout:1307 writesame 0xc75a08 thru 0xc84891 data_size 0x13(0xee8a bytes) 2024-09-21T13:58:38.745 INFO:teuthology.orchestra.run.smithi079.stdout:1308 writesame 0xe9fd433 thru 0xe9ff5e3 data_size 0x19(0x21b1 bytes) 2024-09-21T13:58:38.748 INFO:teuthology.orchestra.run.smithi079.stdout:1310 read 0x39165e3 thru 0x3923544 (0xcf62 bytes) 2024-09-21T13:58:38.749 INFO:teuthology.orchestra.run.smithi079.stdout:1311 read 0x22abdab thru 0x22b4735 (0x898b bytes) 2024-09-21T13:58:38.750 INFO:teuthology.orchestra.run.smithi079.stdout:1312 write 0x7b1dd17 thru 0x7b205e8 (0x28d2 bytes) 2024-09-21T13:58:38.764 INFO:teuthology.orchestra.run.smithi079.stdout:1314 trunc from 0xed240a8 to 0xb381a43 2024-09-21T13:58:38.779 INFO:teuthology.orchestra.run.smithi079.stdout:1315 read 0x6e49641 thru 0x6e4c479 (0x2e39 bytes) 2024-09-21T13:58:38.779 INFO:teuthology.orchestra.run.smithi079.stdout:1317 read 0x6fba7ca thru 0x6fc1464 (0x6c9b bytes) 2024-09-21T13:58:38.796 INFO:teuthology.orchestra.run.smithi079.stdout:1318 trunc from 0xb381a43 to 0x52a6016 2024-09-21T13:58:38.812 INFO:teuthology.orchestra.run.smithi079.stdout:1319 writesame 0x433347 thru 0x43de45 data_size 0x19(0xaaff bytes) 2024-09-21T13:58:38.817 INFO:teuthology.orchestra.run.smithi079.stdout:1320 write 0xb99fc6 thru 0xba4825 (0xa860 bytes) 2024-09-21T13:58:38.819 INFO:teuthology.orchestra.run.smithi079.stdout:1321 read 0x412d93c thru 0x413783d (0x9f02 bytes) 2024-09-21T13:58:38.820 INFO:teuthology.orchestra.run.smithi079.stdout:1322 read 0x1fe0504 thru 0x1feaa1a (0xa517 bytes) 2024-09-21T13:58:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:1326 write 0x101b32a thru 0x1024ff6 (0x9ccd bytes) 2024-09-21T13:58:38.825 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:38.824+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:38.825 INFO:teuthology.orchestra.run.smithi079.stdout:1327 write 0x3694ea4 thru 0x3696eec (0x2049 bytes) 2024-09-21T13:58:38.828 INFO:teuthology.orchestra.run.smithi079.stdout:1328 read 0x25c7712 thru 0x25c86c3 (0xfb2 bytes) 2024-09-21T13:58:38.829 INFO:teuthology.orchestra.run.smithi079.stdout:1329 punch from 0x4c5c633 to 0x4c5ebc8, (0x2595 bytes) 2024-09-21T13:58:38.829 INFO:teuthology.orchestra.run.smithi079.stdout:1330 punch from 0xc14344 to 0xc23817, (0xf4d3 bytes) 2024-09-21T13:58:38.830 INFO:teuthology.orchestra.run.smithi079.stdout:1331 writesame 0x2872faa thru 0x28775cf data_size 0x52(0x4626 bytes) 2024-09-21T13:58:38.833 INFO:teuthology.orchestra.run.smithi079.stdout:1332 write 0x27e66d1 thru 0x27f2888 (0xc1b8 bytes) 2024-09-21T13:58:38.836 INFO:teuthology.orchestra.run.smithi079.stdout:1334 punch from 0x2288f3 to 0x22fa75, (0x7182 bytes) 2024-09-21T13:58:38.847 INFO:teuthology.orchestra.run.smithi079.stdout:1335 writesame 0x551c448 thru 0x5527763 data_size 0x6(0xb31c bytes) 2024-09-21T13:58:38.850 INFO:teuthology.orchestra.run.smithi079.stdout:1336 writesame 0x132fb4 thru 0x139161 data_size 0x1(0x61ae bytes) 2024-09-21T13:58:38.864 INFO:teuthology.orchestra.run.smithi079.stdout:1338 read 0x313e0bf thru 0x31400c0 (0x2002 bytes) 2024-09-21T13:58:38.884 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:38.880+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:38.899 INFO:teuthology.orchestra.run.smithi079.stdout:1339 write 0xdd1cee8 thru 0xdd28dc7 (0xbee0 bytes) 2024-09-21T13:58:38.902 INFO:teuthology.orchestra.run.smithi079.stdout:1340 writesame 0x249a816 thru 0x249ad53 data_size 0x2(0x53e bytes) 2024-09-21T13:58:38.905 INFO:teuthology.orchestra.run.smithi079.stdout:1341 punch from 0x936059c to 0x9360e4a, (0x8ae bytes) 2024-09-21T13:58:38.905 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.906 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:38.906 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:38.906 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:38.906 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:38.906 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:38.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:38.934 INFO:teuthology.orchestra.run.smithi079.stdout:1344 trunc from 0xdd28dc8 to 0x215fe3f 2024-09-21T13:58:38.973 INFO:teuthology.orchestra.run.smithi079.stdout:1345 write 0x65e8b07 thru 0x65f5eda (0xd3d4 bytes) 2024-09-21T13:58:38.978 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:38.978 INFO:teuthology.orchestra.run.smithi079.stdout:1347 read 0x3345cbf thru 0x3347cd6 (0x2018 bytes) 2024-09-21T13:58:38.979 INFO:teuthology.orchestra.run.smithi079.stdout:1349 read 0x3a852a2 thru 0x3a8ee72 (0x9bd1 bytes) 2024-09-21T13:58:38.984 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:38.983+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:39.011 INFO:teuthology.orchestra.run.smithi079.stdout:1350 writesame 0xddc5bdb thru 0xddc82c5 data_size 0x1b(0x26eb bytes) 2024-09-21T13:58:39.014 INFO:teuthology.orchestra.run.smithi079.stdout:1351 writesame 0x925d2f1 thru 0x926c7c2 data_size 0x1(0xf4d2 bytes) 2024-09-21T13:58:39.067 INFO:teuthology.orchestra.run.smithi079.stdout:1352 writesame 0xa13d59f thru 0xa145fd8 data_size 0xd(0x8a3a bytes) 2024-09-21T13:58:39.071 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.071 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.071 INFO:teuthology.orchestra.run.smithi079.stdout:1358 writesame 0x455dc10 thru 0x456be31 data_size 0xe(0xe222 bytes) 2024-09-21T13:58:39.084 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:39.080+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:2889 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 884736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.887057+0000", 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.2024402040000002, 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013619259999999999, 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 2889 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887057+0000", 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887057+0000", 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887055+0000", 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887066+0000", 2024-09-21T13:58:39.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1187e-05 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887088+0000", 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2229999999999999e-05 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.887168+0000", 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9616000000000005e-05 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.900148+0000", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012979622999999999 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.900416+0000", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000268485 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.900676+0000", 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025994899999999999 2024-09-21T13:58:39.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3238 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 393216~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.911797+0000", 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1777005750000002, 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010798815999999999, 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3238 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911797+0000", 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911797+0000", 2024-09-21T13:58:39.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911795+0000", 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911801+0000", 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5690000000000004e-06 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911816+0000", 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5003e-05 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911828+0000", 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1928e-05 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922245+0000", 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010417584000000001 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922408+0000", 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162876 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922595+0000", 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018699100000000001 2024-09-21T13:58:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3249 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1310720~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.911949+0000", 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1775478049999997, 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011045851000000001, 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3249 2024-09-21T13:58:39.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911949+0000", 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911949+0000", 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911948+0000", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911954+0000", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7429999999999999e-06 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911971+0000", 2024-09-21T13:58:39.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6923e-05 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.911983+0000", 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2565000000000001e-05 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922652+0000", 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010669098 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922810+0000", 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000157892 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922995+0000", 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018483900000000001 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3251 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1376256~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912036+0000", 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.177460806, 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011352513, 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3251 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912036+0000", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912036+0000", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912036+0000", 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912040+0000", 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.814e-06 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912055+0000", 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.504e-05 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912067+0000", 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1817000000000001e-05 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923050+0000", 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010983098 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923212+0000", 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016203100000000001 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923389+0000", 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000176501 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3252 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1409024~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912077+0000", 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1774201089999998, 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011720213, 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3252 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912077+0000", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912077+0000", 2024-09-21T13:58:39.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912076+0000", 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912095+0000", 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8583000000000001e-05 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912110+0000", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5614e-05 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912122+0000", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1939999999999999e-05 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923446+0000", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011324054 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923605+0000", 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015843899999999999 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923797+0000", 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019250300000000001 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3256 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1343488~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912133+0000", 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1773643549999999, 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012008886, 2024-09-21T13:58:39.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3256 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912133+0000", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912133+0000", 2024-09-21T13:58:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912132+0000", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912137+0000", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1080000000000001e-06 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912152+0000", 2024-09-21T13:58:39.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4922999999999999e-05 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912163+0000", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1377e-05 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923855+0000", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011691933 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924025+0000", 2024-09-21T13:58:39.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017026199999999999 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924142+0000", 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116223 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3264 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 524288~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912275+0000", 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1772220989999997, 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012187118, 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3264 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912275+0000", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912275+0000", 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912274+0000", 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912279+0000", 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5890000000000002e-06 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912295+0000", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5888000000000001e-05 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912308+0000", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3097e-05 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924200+0000", 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011891956 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924351+0000", 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015119800000000001 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924462+0000", 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110782 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.120 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3265 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 557056~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912320+0000", 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.177176888, 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012547203999999999, 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3265 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912320+0000", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912320+0000", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912319+0000", 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912325+0000", 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7660000000000004e-06 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912341+0000", 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5503e-05 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912375+0000", 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3957e-05 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924517+0000", 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012142795 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924674+0000", 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015686399999999999 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924867+0000", 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019323100000000001 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3266 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 589824~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912389+0000", 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1771077539999997, 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012737284, 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3266 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912389+0000", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912389+0000", 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912388+0000", 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912395+0000", 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1520000000000003e-06 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912412+0000", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7422e-05 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912438+0000", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5639999999999998e-05 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.924923+0000", 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012484775 2024-09-21T13:58:39.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925027+0000", 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104026 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925127+0000", 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9741000000000006e-05 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3270 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 622592~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912450+0000", 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1770469889999999, 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012985273, 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3270 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912450+0000", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912450+0000", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912449+0000", 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912455+0000", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3860000000000004e-06 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912472+0000", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6314e-05 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912484+0000", 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2317000000000001e-05 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925177+0000", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01269317 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925285+0000", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107935 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925435+0000", 2024-09-21T13:58:39.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015031699999999999 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3274 3.14 3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:5 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912603+0000", 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1768941699999997, 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010661158, 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3274 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912603+0000", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912603+0000", 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912602+0000", 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912607+0000", 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.434e-06 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912624+0000", 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6748999999999998e-05 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912637+0000", 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2707999999999999e-05 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.922940+0000", 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010303533 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923106+0000", 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166124 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923264+0000", 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015759300000000001 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3275 3.14 3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:5 [read 1802240~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912648+0000", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.176848831, 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011074586000000001, 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3275 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912648+0000", 2024-09-21T13:58:39.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912648+0000", 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912647+0000", 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912652+0000", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3199999999999999e-06 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912668+0000", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6028e-05 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912683+0000", 2024-09-21T13:58:39.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4528999999999999e-05 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923338+0000", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010655329 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923510+0000", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172084 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.923723+0000", 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021264100000000001 2024-09-21T13:58:39.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3276 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1441792~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912694+0000", 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1768027080000003, 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013065053, 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3276 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912694+0000", 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912694+0000", 2024-09-21T13:58:39.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912693+0000", 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912713+0000", 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9312000000000001e-05 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912727+0000", 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4647999999999999e-05 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912734+0000", 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7290000000000003e-06 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925483+0000", 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012748552999999999 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925619+0000", 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013593700000000001 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925759+0000", 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014082299999999999 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3277 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1474560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912741+0000", 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1767561459999998, 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013429450000000001, 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3277 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912741+0000", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912741+0000", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912740+0000", 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:39.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912744+0000", 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5549999999999998e-06 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912752+0000", 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9310000000000008e-06 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912758+0000", 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.003e-06 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925812+0000", 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013054349 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.925996+0000", 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018425000000000001 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926170+0000", 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017406499999999999 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3278 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1507328~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912763+0000", 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1767338260000004, 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013774055, 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3278 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912763+0000", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912763+0000", 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912763+0000", 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912765+0000", 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7970000000000001e-06 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912773+0000", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6459999999999993e-06 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912791+0000", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8179999999999999e-05 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926226+0000", 2024-09-21T13:58:39.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013434532000000001 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926369+0000", 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014356500000000001 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926537+0000", 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016798900000000001 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3279 3.1a 3:5d23bf7f:::rbd_data.1185e8851f1.000000000000000d:5 [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.912852+0000", 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1766452919999999, 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014060441999999999, 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3279 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912852+0000", 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912852+0000", 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912850+0000", 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912865+0000", 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4990999999999999e-05 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912884+0000", 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8403e-05 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.912897+0000", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.366e-05 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926587+0000", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013689178999999999 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926743+0000", 2024-09-21T13:58:39.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156508 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.926912+0000", 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016920100000000001 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3521 3.9 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.956191+0000", 2024-09-21T13:58:39.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1333057420000001, 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016793108000000001, 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3521 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.956191+0000", 2024-09-21T13:58:39.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.956191+0000", 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.956189+0000", 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.958821+0000", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00263225 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959151+0000", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033008199999999999 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959185+0000", 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3760999999999997e-05 2024-09-21T13:58:39.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959289+0000", 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104152 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959602+0000", 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000313023 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:39.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.960510+0000", 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00090727400000000001 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.966630+0000", 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00612022 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972885+0000", 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062555739999999999 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972946+0000", 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0683000000000002e-05 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972984+0000", 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8291000000000003e-05 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:3520 3.f e33/23 3:f3452365:::rbd_data.1185e0e4cd61.0000000000000005:head v 33'44, mlcod=33'42)", 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.957994+0000", 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1315033830000001, 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014509592999999999, 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.957994+0000", 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.957994+0000", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.957992+0000", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959587+0000", 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001594956 2024-09-21T13:58:39.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959607+0000", 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9851e-05 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959637+0000", 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9972e-05 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959747+0000", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109764 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959812+0000", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5110999999999994e-05 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972452+0000", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012640293 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972503+0000", 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1038999999999997e-05 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:3525 3.14 3:2ec6815d:::rbd_data.1185e0e4cd61.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,truncate 1703936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:32.959210+0000", 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.1302871730000001, 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013836965999999999, 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3525 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959210+0000", 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959210+0000", 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.959208+0000", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962108+0000", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028997680000000001 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962128+0000", 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0523999999999999e-05 2024-09-21T13:58:39.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962139+0000", 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0712e-05 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962204+0000", 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4859999999999999e-05 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962421+0000", 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021745900000000001 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.962695+0000", 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027350200000000001 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972611+0000", 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099167930000000001 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.972953+0000", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000341138 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.973019+0000", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6611000000000003e-05 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:32.973047+0000", 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7727000000000001e-05 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7168 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:38.067311+0000", 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.0221857510000001, 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012900386999999999, 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7168 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067311+0000", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067311+0000", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067309+0000", 2024-09-21T13:58:39.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067323+0000", 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4277000000000001e-05 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067355+0000", 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1389000000000001e-05 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067370+0000", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4856e-05 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067509+0000", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000139486 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.067759+0000", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025004500000000001 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:39.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.069842+0000", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002083344 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.079929+0000", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010086418999999999 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.079962+0000", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3039e-05 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:39.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.080093+0000", 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131273 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:38.080212+0000", 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118602 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.183 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:39.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:39.185 INFO:teuthology.orchestra.run.smithi079.stdout:1359 writesame 0xde70252 thru 0xde737e4 data_size 0xd(0x3593 bytes) 2024-09-21T13:58:39.185 INFO:teuthology.orchestra.run.smithi079.stdout:1360 trunc from 0xde737e5 to 0x8832ee 2024-09-21T13:58:39.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:39.187 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:39.187+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:39.193 INFO:teuthology.orchestra.run.smithi079.stdout:1362 write 0xed946e1 thru 0xed9c9e3 (0x8303 bytes) 2024-09-21T13:58:39.217 INFO:teuthology.orchestra.run.smithi079.stdout:1363 trunc from 0xed9c9e4 to 0x2e6c688 2024-09-21T13:58:39.247 INFO:teuthology.orchestra.run.smithi079.stdout:1366 write 0x97bfa71 thru 0x97c6c87 (0x7217 bytes) 2024-09-21T13:58:39.249 INFO:teuthology.orchestra.run.smithi079.stdout:1367 writesame 0x88d46c2 thru 0x88d8eea data_size 0x31(0x4829 bytes) 2024-09-21T13:58:39.251 INFO:teuthology.orchestra.run.smithi079.stdout:1368 punch from 0x801e272 to 0x8022c3f, (0x49cd bytes) 2024-09-21T13:58:39.252 INFO:teuthology.orchestra.run.smithi079.stdout:1369 write 0x32fe5f0 thru 0x3301ee5 (0x38f6 bytes) 2024-09-21T13:58:39.253 INFO:teuthology.orchestra.run.smithi079.stdout:1370 write 0x4316185 thru 0x432411f (0xdf9b bytes) 2024-09-21T13:58:39.256 INFO:teuthology.orchestra.run.smithi079.stdout:1371 read 0x666f5d8 thru 0x6671b32 (0x255b bytes) 2024-09-21T13:58:39.256 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.256 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.268 INFO:teuthology.orchestra.run.smithi079.stdout:1374 trunc from 0x97c6c88 to 0x23cbb83 2024-09-21T13:58:39.282 INFO:teuthology.orchestra.run.smithi079.stdout:1375 trunc from 0x23cbb83 to 0x3e5c523 2024-09-21T13:58:39.287 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:39.284+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:39.302 INFO:teuthology.orchestra.run.smithi079.stdout:1378 trunc from 0x3e5c523 to 0xa2c6895 2024-09-21T13:58:39.311 INFO:teuthology.orchestra.run.smithi079.stdout:1381 read 0x51c0754 thru 0x51c6839 (0x60e6 bytes) 2024-09-21T13:58:39.312 INFO:teuthology.orchestra.run.smithi079.stdout:1382 write 0x2000d31 thru 0x200213b (0x140b bytes) 2024-09-21T13:58:39.314 INFO:teuthology.orchestra.run.smithi079.stdout:1384 read 0x6ca01fa thru 0x6ca8eeb (0x8cf2 bytes) 2024-09-21T13:58:39.315 INFO:teuthology.orchestra.run.smithi079.stdout:1385 read 0x87670cf thru 0x876e0b3 (0x6fe5 bytes) 2024-09-21T13:58:39.315 INFO:teuthology.orchestra.run.smithi079.stdout:1386 writesame 0x1183772 thru 0x1185956 data_size 0x1(0x21e5 bytes) 2024-09-21T13:58:39.323 INFO:teuthology.orchestra.run.smithi079.stdout:1387 writesame 0x4b1f05f thru 0x4b2e600 data_size 0x17(0xf5a2 bytes) 2024-09-21T13:58:39.325 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.333 INFO:teuthology.orchestra.run.smithi079.stdout:1389 write 0xab2f0ff thru 0xab3a05f (0xaf61 bytes) 2024-09-21T13:58:39.334 INFO:teuthology.orchestra.run.smithi079.stdout:1392 read 0x120df9a thru 0x120e574 (0x5db bytes) 2024-09-21T13:58:39.347 INFO:teuthology.orchestra.run.smithi079.stdout:1393 write 0xe3ff383 thru 0xe403382 (0x4000 bytes) 2024-09-21T13:58:39.348 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:39.348 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:39.362 INFO:teuthology.orchestra.run.smithi079.stdout:1394 trunc from 0xe403383 to 0x51d9993 2024-09-21T13:58:39.366 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:39.366 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:7806 3.2 e36/23 3:42953341:::rbd_header.11853c86949e:head v 36'129, mlcod=36'127)", 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:39.370052+0000", 2024-09-21T13:58:39.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001585948, 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016323679999999999, 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370052+0000", 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:39.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370052+0000", 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370051+0000", 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370059+0000", 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1640000000000001e-06 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370071+0000", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1467e-05 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370077+0000", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3169999999999998e-06 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370136+0000", 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9521000000000002e-05 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:39.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.370171+0000", 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4876000000000003e-05 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-21T13:58:39.373 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:39.374 INFO:teuthology.orchestra.run.smithi079.stdout:1395 trunc from 0x51d9993 to 0x514223a 2024-09-21T13:58:39.383 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:39.383 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:39.384 INFO:teuthology.orchestra.run.smithi079.stdout:1396 read 0x11cddbc thru 0x11d0062 (0x22a7 bytes) 2024-09-21T13:58:39.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.386 INFO:teuthology.orchestra.run.smithi079.stdout:1398 read 0x86b008 thru 0x86ce53 (0x1e4c bytes) 2024-09-21T13:58:39.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:39.388 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:39.387+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:39.397 INFO:teuthology.orchestra.run.smithi079.stdout:1399 trunc from 0x514223a to 0xc25f93a 2024-09-21T13:58:39.400 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:39.400 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:39.405 INFO:teuthology.orchestra.run.smithi079.stdout:1401 read 0x8eb2cb0 thru 0x8eba99c (0x7ced bytes) 2024-09-21T13:58:39.408 INFO:teuthology.orchestra.run.smithi079.stdout:1403 trunc from 0xc25f93a to 0xafc99e9 2024-09-21T13:58:39.417 INFO:teuthology.orchestra.run.smithi079.stdout:1404 read 0x277f5f4 thru 0x2787656 (0x8063 bytes) 2024-09-21T13:58:39.418 INFO:teuthology.orchestra.run.smithi079.stdout:1405 write 0x87232 thru 0x88204 (0xfd3 bytes) 2024-09-21T13:58:39.419 INFO:teuthology.orchestra.run.smithi079.stdout:1406 read 0x587b894 thru 0x587b8c4 (0x31 bytes) 2024-09-21T13:58:39.419 INFO:teuthology.orchestra.run.smithi079.stdout:1407 read 0x27d1f5a thru 0x27d8625 (0x66cc bytes) 2024-09-21T13:58:39.423 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:39.424 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:39.427 INFO:teuthology.orchestra.run.smithi079.stdout:1408 write 0xb3ad872 thru 0xb3b2343 (0x4ad2 bytes) 2024-09-21T13:58:39.439 INFO:teuthology.orchestra.run.smithi079.stdout:1409 trunc from 0xb3b2344 to 0x4df82bf 2024-09-21T13:58:39.444 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:39.444 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:39.447 INFO:teuthology.orchestra.run.smithi079.stdout:1410 punch from 0x242862d to 0x243227a, (0x9c4d bytes) 2024-09-21T13:58:39.447 INFO:teuthology.orchestra.run.smithi079.stdout:1411 flatten 2024-09-21T13:58:39.454 INFO:teuthology.orchestra.run.smithi079.stdout:1413 write 0x3c87899 thru 0x3c87c51 (0x3b9 bytes) 2024-09-21T13:58:39.456 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.456 INFO:teuthology.orchestra.run.smithi079.stdout:1415 read 0x3b869db thru 0x3b8f165 (0x878b bytes) 2024-09-21T13:58:39.462 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:39.462 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:39.471 INFO:teuthology.orchestra.run.smithi079.stdout:1416 write 0xa337ed3 thru 0xa3420d7 (0xa205 bytes) 2024-09-21T13:58:39.472 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.473 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.481 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:39.481 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:39.481 INFO:teuthology.orchestra.run.smithi079.stdout:1419 trunc from 0xa3420d8 to 0x42bac0c 2024-09-21T13:58:39.488 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:39.487+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:39.490 INFO:teuthology.orchestra.run.smithi079.stdout:1421 punch from 0x1318bd4 to 0x1322496, (0x98c2 bytes) 2024-09-21T13:58:39.490 INFO:teuthology.orchestra.run.smithi079.stdout:1422 read 0x27062f4 thru 0x271391f (0xd62c bytes) 2024-09-21T13:58:39.495 INFO:teuthology.orchestra.run.smithi079.stdout:1423 trunc from 0x42bac0c to 0x6fd1125 2024-09-21T13:58:39.501 INFO:teuthology.orchestra.run.smithi079.stdout:1424 writesame 0x2d781b8 thru 0x2d78e4a data_size 0x1d(0xc93 bytes) 2024-09-21T13:58:39.503 INFO:teuthology.orchestra.run.smithi079.stdout:1425 write 0x56d4b30 thru 0x56d73b9 (0x288a bytes) 2024-09-21T13:58:39.505 INFO:teuthology.orchestra.run.smithi079.stdout:1426 punch from 0x45db7ba to 0x45e7b0e, (0xc354 bytes) 2024-09-21T13:58:39.505 INFO:teuthology.orchestra.run.smithi079.stdout:1428 writesame 0x26e7478 thru 0x26ef356 data_size 0x1(0x7edf bytes) 2024-09-21T13:58:39.524 INFO:teuthology.orchestra.run.smithi079.stdout:1429 punch from 0xa6cbfa to 0xa7ae0a, (0xe210 bytes) 2024-09-21T13:58:39.524 INFO:teuthology.orchestra.run.smithi079.stdout:1432 read 0x60e0fa9 thru 0x60e29cd (0x1a25 bytes) 2024-09-21T13:58:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:1435 read 0xce8db9 thru 0xcf4be1 (0xbe29 bytes) 2024-09-21T13:58:39.525 INFO:teuthology.orchestra.run.smithi079.stdout:1436 read 0x29e81d7 thru 0x29f0935 (0x875f bytes) 2024-09-21T13:58:39.542 INFO:teuthology.orchestra.run.smithi079.stdout:1437 write 0xd468bb7 thru 0xd469ef6 (0x1340 bytes) 2024-09-21T13:58:39.544 INFO:teuthology.orchestra.run.smithi079.stdout:1438 write 0x6b93806 thru 0x6b9b4e8 (0x7ce3 bytes) 2024-09-21T13:58:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:1439 read 0x260be72 thru 0x26108dd (0x4a6c bytes) 2024-09-21T13:58:39.547 INFO:teuthology.orchestra.run.smithi079.stdout:1442 write 0x54d7a12 thru 0x54d99e7 (0x1fd6 bytes) 2024-09-21T13:58:39.548 INFO:teuthology.orchestra.run.smithi079.stdout:1443 write 0x91c2143 thru 0x91cdd8d (0xbc4b bytes) 2024-09-21T13:58:39.550 INFO:teuthology.orchestra.run.smithi079.stdout:1444 write 0xb161bd1 thru 0xb16e84b (0xcc7b bytes) 2024-09-21T13:58:39.552 INFO:teuthology.orchestra.run.smithi079.stdout:1445 write 0xb8cf4e7 thru 0xb8d457b (0x5095 bytes) 2024-09-21T13:58:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:39.559 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:39.562 INFO:teuthology.orchestra.run.smithi079.stdout:1449 trunc from 0xd469ef7 to 0x862989d 2024-09-21T13:58:39.573 INFO:teuthology.orchestra.run.smithi079.stdout:1450 read 0x4d2e71d thru 0x4d394e9 (0xadcd bytes) 2024-09-21T13:58:39.574 INFO:teuthology.orchestra.run.smithi079.stdout:1451 write 0x2d4fb0a thru 0x2d5befa (0xc3f1 bytes) 2024-09-21T13:58:39.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:39.589 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:39.587+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:39.591 INFO:teuthology.orchestra.run.smithi079.stdout:1453 write 0xbc54d93 thru 0xbc551ad (0x41b bytes) 2024-09-21T13:58:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:1454 read 0x4d75dba thru 0x4d775aa (0x17f1 bytes) 2024-09-21T13:58:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:39.593 INFO:teuthology.orchestra.run.smithi079.stdout:1456 clone 7 order 18 su 2048 sc 8 2024-09-21T13:58:39.690 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:39.691+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:39.697 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:39.697 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:39.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:39.791 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:39.788+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:39.836 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:39.836 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:39.851 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:39.893 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:39.892+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:39.992 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:39.988+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.014 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:40.093 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:40.091+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:40.189 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.225 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:40.227 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:40.224+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:40.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:58:40.327 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:40.324+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:40.398 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.398 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:40.428 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:40.427+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:40.529 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:40.527+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:40.585 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.585 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.596 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-21T13:58:40.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:40.627 INFO:teuthology.orchestra.run.smithi079.stdout:1457 read 0x3b57ee4 thru 0x3b654a6 (0xd5c3 bytes) 2024-09-21T13:58:40.636 INFO:teuthology.orchestra.run.smithi079.stdout:1459 trunc from 0xbc551ae to 0xb80aded 2024-09-21T13:58:40.645 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:40.644+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:40.730 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:40.731+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:40.745 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.745 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.748 INFO:teuthology.orchestra.run.smithi079.stdout:1460 writesame 0xdcf859 thru 0xddc328 data_size 0x76(0xcad0 bytes) 2024-09-21T13:58:40.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:40.831 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:40.831+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:40.880 INFO:teuthology.orchestra.run.smithi079.stdout:1461 read 0x46f1fc1 thru 0x46f2ab1 (0xaf1 bytes) 2024-09-21T13:58:40.880 INFO:teuthology.orchestra.run.smithi079.stdout:1462 write 0x45ab049 thru 0x45ad4ec (0x24a4 bytes) 2024-09-21T13:58:40.907 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:40.907 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:40.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:40.966 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:40.967+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:40.970 INFO:teuthology.orchestra.run.smithi079.stdout:1464 trunc from 0xb80aded to 0xc703384 2024-09-21T13:58:40.978 INFO:teuthology.orchestra.run.smithi079.stdout:1465 punch from 0x8e5dfa5 to 0x8e65cc6, (0x7d21 bytes) 2024-09-21T13:58:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:1467 writesame 0xd73f73c thru 0xd743456 data_size 0x1(0x3d1b bytes) 2024-09-21T13:58:40.988 INFO:teuthology.orchestra.run.smithi079.stdout:1468 write 0x798e267 thru 0x799b59d (0xd337 bytes) 2024-09-21T13:58:41.032 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:41.031+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:41.103 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:41.103 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:41.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:41.133 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:41.132+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:41.153 INFO:teuthology.orchestra.run.smithi079.stdout:1469 trunc from 0xd743457 to 0x6c9cc22 2024-09-21T13:58:41.233 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:41.232+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:41.237 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:41.237 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:41.237 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.30835875364358173 2024-09-21T13:58:41.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.30835875364358173 2024-09-21T13:58:41.272 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:58:41.301 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:41.302 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:41.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:41.335 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:41.332+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:41.373 INFO:teuthology.orchestra.run.smithi079.stdout:1471 clone 8 order 23 su 524288 sc 15 2024-09-21T13:58:41.435 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:41.432+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:41.481 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:41.481 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:41.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:41.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:41.536 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:41.532+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:41.637 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:41.636+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:41.652 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:41.652 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:41.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:41.681 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:41.681 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:41.697 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:41.697 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:41.715 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:41.732 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:41.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:41.735+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:41.751 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:41.751 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:41.771 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:41.771 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.954088820999999, 2024-09-21T13:58:41.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:58:41.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:58:41.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:58:41.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.814065381000001, 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.796 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:58:41.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.801 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.785806376, 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:41.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.888697831, 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.806 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:58:41.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8886363619999997, 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.810 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:58:41.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:41.814 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8804656120000001, 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:58:41.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:58:41.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8795723869999996, 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:58:41.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8795146270000007, 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:58:41.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794960350000007, 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:58:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794836969999995, 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:58:41.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.836 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794619610000005, 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:41.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.841 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794387780000008, 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:58:41.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:58:41.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794183489999998, 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.849 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:58:41.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:58:41.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8794035509999993, 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:58:41.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:58:41.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8793789669999992, 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8793622709999998, 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:58:41.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:58:41.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.8793400340000002, 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:58:41.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9610517309999995, 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:58:41.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:58:41.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:58:41.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.7915331830000003, 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:41.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:58:41.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:41.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:41.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.4282945890000001, 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:41.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:41.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:41.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:41.888 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:41.889 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:41.889 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:41.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:41.890 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:41.891 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:41.891 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:41.888+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:41.990 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:41.988+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:42.059 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.059 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:42.060 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:42.060 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:42.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:42.118 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:42.119+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:42.192 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:42.188+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:42.195 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.195 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:42.196 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:42.196 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:42.196 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:42.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:42.277 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.1 to 0.308359 (4ef0) 2024-09-21T13:58:42.292 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:42.291+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:42.388 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:861 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'171, mlcod=29'167)", 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.91896002, 2024-09-21T13:58:42.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002361892, 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468088+0000", 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468087+0000", 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468105+0000", 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7595e-05 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468115+0000", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0902e-05 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468124+0000", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2819999999999996e-06 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468197+0000", 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-21T13:58:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.468232+0000", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4703000000000003e-05 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470415+0000", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021829739999999999 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.470450+0000", 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4885000000000002e-05 2024-09-21T13:58:42.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:912 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'185, mlcod=29'183)", 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.763401321, 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020263149999999999, 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623646+0000", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623645+0000", 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623657+0000", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2257e-05 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623679+0000", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1957e-05 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623689+0000", 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:42.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623796+0000", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107624 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.623853+0000", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6849999999999999e-05 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625607+0000", 2024-09-21T13:58:42.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017542600000000001 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.625673+0000", 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5386e-05 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:922 3.4 e29/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 29'189, mlcod=29'187)", 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.716754547000001, 2024-09-21T13:58:42.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025362470000000002, 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670293+0000", 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670291+0000", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670307+0000", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6393e-05 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670340+0000", 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2897e-05 2024-09-21T13:58:42.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670354+0000", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.42e-05 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670473+0000", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119172 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.670511+0000", 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7466999999999999e-05 2024-09-21T13:58:42.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672732+0000", 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002220816 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.672829+0000", 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7656000000000001e-05 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1048 3.4 e29/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 29'221, mlcod=29'218)", 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.258453285, 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033734450000000001, 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128594+0000", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128593+0000", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128602+0000", 2024-09-21T13:58:42.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128630+0000", 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7260999999999999e-05 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128641+0000", 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0994e-05 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128692+0000", 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1793999999999999e-05 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.128722+0000", 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9870999999999999e-05 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131932+0000", 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032095729999999999 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.131968+0000", 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6031000000000001e-05 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1083 3.4 e30/23 3:27acbb70:::rbd_data.1185e8851f1.0000000000000025:head v 30'229, mlcod=29'225)", 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.155446855999999, 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002238987, 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.407 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231601+0000", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231600+0000", 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:42.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231605+0000", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.481e-06 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231614+0000", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4069999999999999e-06 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231620+0000", 2024-09-21T13:58:42.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5439999999999998e-06 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231686+0000", 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6103000000000001e-05 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.231723+0000", 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6770000000000002e-05 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233790+0000", 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020677730000000002 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.233840+0000", 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9447000000000003e-05 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1085 3.4 e30/23 3:20d3cea9:::rbd_data.1185e8851f1.0000000000000028:head v 30'230, mlcod=30'227)", 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:42.411 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.154223587000001, 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028868180000000002, 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232824+0000", 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232823+0000", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232834+0000", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0621e-05 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232852+0000", 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8546000000000002e-05 2024-09-21T13:58:42.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232880+0000", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7421999999999999e-05 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232945+0000", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5514999999999999e-05 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.232980+0000", 2024-09-21T13:58:42.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5070000000000001e-05 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235681+0000", 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027004450000000001 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.235711+0000", 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0318999999999999e-05 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1086 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'231, mlcod=30'228)", 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.152161379000001, 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002857708, 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234886+0000", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234885+0000", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234895+0000", 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7450000000000007e-06 2024-09-21T13:58:42.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234913+0000", 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.753e-05 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234922+0000", 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5470000000000002e-06 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234966+0000", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3582999999999999e-05 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.234983+0000", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7149000000000001e-05 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237710+0000", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027272849999999999 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237744+0000", 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3964000000000002e-05 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1087 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'232, mlcod=30'228)", 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.151011262000001, 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003476987, 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236036+0000", 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236044+0000", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2700000000000004e-06 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236060+0000", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5739999999999998e-05 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236068+0000", 2024-09-21T13:58:42.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4430000000000003e-06 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236103+0000", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4428000000000003e-05 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.236121+0000", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8099999999999999e-05 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239473+0000", 2024-09-21T13:58:42.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003352486 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239513+0000", 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0343000000000003e-05 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:1088 3.4 e30/23 3:20b70209:::rbd_object_map.1185e8851f1:head v 30'233, mlcod=30'229)", 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.149875935000001, 2024-09-21T13:58:42.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002368682, 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237172+0000", 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237171+0000", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237177+0000", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2169999999999999e-06 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237192+0000", 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.433e-05 2024-09-21T13:58:42.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237198+0000", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6699999999999997e-06 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237243+0000", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4879999999999997e-05 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.237261+0000", 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7629999999999999e-05 2024-09-21T13:58:42.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239517+0000", 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022558729999999998 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.239540+0000", 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3822999999999999e-05 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2332 3.4 e33/23 3:23f6b2a4:::rbd_header.1185e0e4cd61:head v 33'296, mlcod=32'294)", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.070187635, 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024063629999999999, 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316860+0000", 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316859+0000", 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316866+0000", 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8240000000000002e-06 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316877+0000", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1143e-05 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316885+0000", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8720000000000002e-06 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316923+0000", 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8092000000000001e-05 2024-09-21T13:58:42.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.316937+0000", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3395e-05 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319238+0000", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023008730000000002 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.319266+0000", 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8911000000000002e-05 2024-09-21T13:58:42.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2618 3.0 e33/23 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.5500249460000006, 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038473650000000002, 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837023+0000", 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837020+0000", 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837040+0000", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0369000000000001e-05 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837084+0000", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3754000000000002e-05 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837107+0000", 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2606e-05 2024-09-21T13:58:42.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837225+0000", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118353 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837267+0000", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2116000000000001e-05 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840831+0000", 2024-09-21T13:58:42.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035635390000000001 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.840870+0000", 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9304000000000002e-05 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2617 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'23, mlcod=32'21)", 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.5490571489999994, 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034007360000000001, 2024-09-21T13:58:42.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837991+0000", 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837990+0000", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.837998+0000", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3310000000000004e-06 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838012+0000", 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3703000000000001e-05 2024-09-21T13:58:42.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838019+0000", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3679999999999996e-06 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838108+0000", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9285999999999999e-05 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.838154+0000", 2024-09-21T13:58:42.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5726999999999998e-05 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841324+0000", 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003170094 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.841391+0000", 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7273000000000005e-05 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:2638 3.9 e33/23 3:93fe32ca:::rbd_data.1185e0e4cd61.0000000000000019:head v 33'24, mlcod=33'22)", 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.5195395380000001, 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031467190000000001, 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867508+0000", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867507+0000", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867527+0000", 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9653e-05 2024-09-21T13:58:42.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867540+0000", 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3434999999999999e-05 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867548+0000", 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9039999999999992e-06 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867804+0000", 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000255839 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.867847+0000", 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2883999999999998e-05 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870565+0000", 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027180889999999999 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.870655+0000", 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0032999999999997e-05 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3521 3.9 e33/23 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head v 33'25, mlcod=33'23)", 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4263860719999997, 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056663929999999996, 2024-09-21T13:58:42.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960662+0000", 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.960646+0000", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999847 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963517+0000", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028708319999999998 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963538+0000", 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0809999999999999e-05 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963547+0000", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8959999999999992e-06 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963602+0000", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5047000000000003e-05 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.963622+0000", 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0227000000000001e-05 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966242+0000", 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026194790000000001 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.966328+0000", 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6526000000000005e-05 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3564 3.4 e33/23 3:22fd9022:::rbd_data.1185e0e4cd61.0000000000000026:head v 33'309, mlcod=33'307)", 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3276711619999997, 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035435229999999998, 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059377+0000", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059375+0000", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059453+0000", 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7869999999999998e-05 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059486+0000", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3389000000000002e-05 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059505+0000", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8686999999999999e-05 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059569+0000", 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4033000000000002e-05 2024-09-21T13:58:42.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.059599+0000", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9895000000000001e-05 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062879+0000", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032800080000000001 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.062920+0000", 2024-09-21T13:58:42.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1467999999999997e-05 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:3911 3.9 e33/23 3:91e508e2:::rbd_data.1185e0e4cd61.0000000000000006:head v 33'35, mlcod=33'33)", 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5570614119999995, 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021728120000000001, 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829986+0000", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829985+0000", 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829996+0000", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0608000000000001e-05 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830015+0000", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9045000000000001e-05 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830026+0000", 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1291000000000001e-05 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830148+0000", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121705 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.830211+0000", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3132999999999993e-05 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.832111+0000", 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001900103 2024-09-21T13:58:42.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.832159+0000", 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8270999999999999e-05 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:7088 3.0 e35/23 3:05b35069:::rbd_data.11853c86949e.0000000000000007:head v 35'41, mlcod=34'39)", 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5163686749999998, 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021232870000000002, 2024-09-21T13:58:42.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870679+0000", 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.870678+0000", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871210+0000", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00053213700000000002 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871231+0000", 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1518e-05 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871240+0000", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871296+0000", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6603e-05 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.871323+0000", 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7019999999999999e-05 2024-09-21T13:58:42.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.872740+0000", 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001416346 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:37.872802+0000", 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2694000000000007e-05 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 36/23 rep_tid 457 entries 36'49 (0'0) error 3:5b350690:::rbd_data.11853c86949e.0000000000000007:head by client.4485.0:7273 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 35'47)", 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:38.254582+0000", 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.132465432, 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002407368, 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254582+0000", 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254582+0000", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254582+0000", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254592+0000", 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0074e-05 2024-09-21T13:58:42.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254622+0000", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0340000000000001e-05 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254640+0000", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7694e-05 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.254721+0000", 2024-09-21T13:58:42.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0841999999999996e-05 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.256990+0000", 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022687979999999998 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:7631 3.0 e36/23 3:05b35069:::rbd_data.11853c86949e.0000000000000007:head v 36'63, mlcod=36'61)", 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:38.939346+0000", 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.4477019929999999, 2024-09-21T13:58:42.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022752850000000002, 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939346+0000", 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939346+0000", 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939343+0000", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939364+0000", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0469999999999999e-05 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939405+0000", 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1386e-05 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939431+0000", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5355999999999999e-05 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939597+0000", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016645599999999999 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.939662+0000", 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5116000000000005e-05 2024-09-21T13:58:42.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.941532+0000", 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018701119999999999 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:38.941621+0000", 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8739000000000005e-05 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:7683 3.0 e36/23 3:05b35069:::rbd_data.11853c86949e.0000000000000007:head v 36'64, mlcod=36'62)", 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:39.133119+0000", 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.253928792, 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002307969, 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133119+0000", 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133119+0000", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133117+0000", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133136+0000", 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9752999999999999e-05 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133185+0000", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8350000000000003e-05 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133205+0000", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0412999999999999e-05 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133378+0000", 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000172685 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.133430+0000", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2250000000000003e-05 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.135336+0000", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019064500000000001 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:39.135427+0000", 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0390999999999996e-05 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.476 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:42.477 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone7 from 0x6c9cc22 (overlap 0x6c9cc22) to 0x61c0485 2024-09-21T13:58:42.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:42.478 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:42.476+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:42.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:42.579+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.22378493599999999, 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.22380175299999999, 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for peered", 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:42.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:58:42.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.183698098, 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.183758488, 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for peered", 2024-09-21T13:58:42.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:42.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.12238484199999999, 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.122481667, 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for peered", 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:42.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:58:42.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:58:42.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 3 2024-09-21T13:58:42.635 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:42.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:42.678 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:42.676+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:42.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:42.779+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:42.795 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.795 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:42.796 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:42.796 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:42.796 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:42.809 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:42.902 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:42.903+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:42.982 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:42.980+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:42.984 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:42.984 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14319 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13309952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457260+0000", 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52681792900000002, 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042473690000000001, 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14319 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.986 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457260+0000", 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457260+0000", 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457260+0000", 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:42.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457262+0000", 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.877e-06 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457265+0000", 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8650000000000003e-06 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:42.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457277+0000", 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1045e-05 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499550+0000", 2024-09-21T13:58:42.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042273968000000002 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499630+0000", 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9482999999999998e-05 2024-09-21T13:58:42.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499734+0000", 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010375299999999999 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:42.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14320 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13326336~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457280+0000", 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52679771399999997, 2024-09-21T13:58:42.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042649412999999997, 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:42.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14320 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457280+0000", 2024-09-21T13:58:42.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457280+0000", 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457280+0000", 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457282+0000", 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.979e-06 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457286+0000", 2024-09-21T13:58:42.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8149999999999999e-06 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457289+0000", 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.168e-06 2024-09-21T13:58:43.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499772+0000", 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042483530999999998 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499843+0000", 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0726e-05 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499930+0000", 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6681999999999994e-05 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14321 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13342720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457291+0000", 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52678662700000001, 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042886795999999998, 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14321 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457291+0000", 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457291+0000", 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457291+0000", 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457297+0000", 2024-09-21T13:58:43.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7490000000000004e-06 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457302+0000", 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8119999999999998e-06 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457305+0000", 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0529999999999998e-06 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.499970+0000", 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042665503 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500063+0000", 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2835000000000001e-05 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500178+0000", 2024-09-21T13:58:43.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115089 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14322 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13359104~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.013 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457308+0000", 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52676989900000004, 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043083992000000002, 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14322 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457308+0000", 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457308+0000", 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457308+0000", 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457309+0000", 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.716e-06 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457314+0000", 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.267e-06 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457317+0000", 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.039e-06 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500216+0000", 2024-09-21T13:58:43.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042899015999999998 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500292+0000", 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6301e-05 2024-09-21T13:58:43.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500392+0000", 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100096 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14323 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13375488~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457321+0000", 2024-09-21T13:58:43.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52675702000000002, 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043293709999999999, 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14323 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457321+0000", 2024-09-21T13:58:43.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457321+0000", 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457321+0000", 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457322+0000", 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6249999999999999e-06 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457326+0000", 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.569e-06 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457330+0000", 2024-09-21T13:58:43.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5279999999999997e-06 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500431+0000", 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043100945000000002 2024-09-21T13:58:43.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500514+0000", 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3079999999999997e-05 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500615+0000", 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100212 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14324 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13391872~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457334+0000", 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52674412999999998, 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043487065999999998, 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14324 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457334+0000", 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457334+0000", 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457334+0000", 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457339+0000", 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9370000000000003e-06 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457343+0000", 2024-09-21T13:58:43.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6149999999999999e-06 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457346+0000", 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.066e-06 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500653+0000", 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043306331000000003 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500721+0000", 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8637e-05 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500821+0000", 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9735000000000006e-05 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14325 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13408256~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457362+0000", 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52671588999999996, 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043659498999999997, 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14325 2024-09-21T13:58:43.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457362+0000", 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457362+0000", 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457361+0000", 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457364+0000", 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.086e-06 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457368+0000", 2024-09-21T13:58:43.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1729999999999997e-06 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457371+0000", 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3210000000000001e-06 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500863+0000", 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043492325999999998 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.500927+0000", 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3800000000000006e-05 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501022+0000", 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4393000000000002e-05 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14326 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13424640~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457379+0000", 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52669887500000001, 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043743935999999997, 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14326 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457379+0000", 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457379+0000", 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457379+0000", 2024-09-21T13:58:43.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457380+0000", 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5349999999999999e-06 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457384+0000", 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8650000000000003e-06 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457387+0000", 2024-09-21T13:58:43.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1370000000000002e-06 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501040+0000", 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043652951000000002 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501079+0000", 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8634999999999999e-05 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501123+0000", 2024-09-21T13:58:43.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4079999999999998e-05 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14327 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13441024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457390+0000", 2024-09-21T13:58:43.056 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52668758599999999, 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043826740000000003, 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14327 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457390+0000", 2024-09-21T13:58:43.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457390+0000", 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457390+0000", 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457392+0000", 2024-09-21T13:58:43.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.717e-06 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457398+0000", 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5919999999999997e-06 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457403+0000", 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5460000000000002e-06 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501137+0000", 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043734268 2024-09-21T13:58:43.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501173+0000", 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5816999999999999e-05 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501217+0000", 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4359e-05 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.064 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14328 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13457408~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457406+0000", 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52667227000000005, 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043984022999999997, 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14328 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457406+0000", 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457406+0000", 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457405+0000", 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457407+0000", 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457411+0000", 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3279999999999999e-06 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457419+0000", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4730000000000003e-06 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501235+0000", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043816257999999997 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501303+0000", 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7731999999999995e-05 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501390+0000", 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6953999999999995e-05 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14329 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13473792~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457422+0000", 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52665624700000002, 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044153822000000002, 2024-09-21T13:58:43.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14329 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457422+0000", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457422+0000", 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457421+0000", 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457423+0000", 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7719999999999999e-06 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457428+0000", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1399999999999999e-06 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457431+0000", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9249999999999999e-06 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501426+0000", 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043994448999999998 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501498+0000", 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2297000000000003e-05 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501576+0000", 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7651000000000006e-05 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.074 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14330 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13490176~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457435+0000", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52664295800000005, 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044306450999999997, 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14330 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457435+0000", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457435+0000", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457435+0000", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457437+0000", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1500000000000002e-06 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457443+0000", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5629999999999997e-06 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457450+0000", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0939999999999996e-06 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501609+0000", 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044159840999999998 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501679+0000", 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0080000000000007e-05 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501741+0000", 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2031000000000003e-05 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14331 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13506560~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457455+0000", 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52662312300000003, 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044399387999999998, 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14331 2024-09-21T13:58:43.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457455+0000", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457455+0000", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457454+0000", 2024-09-21T13:58:43.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457457+0000", 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457465+0000", 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2370000000000003e-06 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457471+0000", 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5749999999999997e-06 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501766+0000", 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044294501 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501809+0000", 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3053000000000003e-05 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501854+0000", 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5531999999999997e-05 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14332 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13522944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457476+0000", 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52660212100000003, 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.04456094, 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14332 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457476+0000", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457476+0000", 2024-09-21T13:58:43.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457476+0000", 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457478+0000", 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.001e-06 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457482+0000", 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.617e-06 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457486+0000", 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2740000000000001e-06 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501878+0000", 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044392009000000003 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.501936+0000", 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8004000000000002e-05 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502037+0000", 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100358 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14333 3.2 3:4694bf8a:::rbd_data.11853c86949e.0000000000000003:a [read 13539328~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.087 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457489+0000", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52658891699999999, 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045045914999999999, 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14333 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457489+0000", 2024-09-21T13:58:43.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457489+0000", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457489+0000", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457495+0000", 2024-09-21T13:58:43.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7410000000000003e-06 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457501+0000", 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4729999999999999e-06 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457504+0000", 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1130000000000001e-06 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502074+0000", 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044569777999999997 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502147+0000", 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3578999999999995e-05 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502535+0000", 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038752399999999998 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14334 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457524+0000", 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.526554462, 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045060017000000001, 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14334 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.092 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457524+0000", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457524+0000", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457523+0000", 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457525+0000", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9539999999999998e-06 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457530+0000", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9219999999999996e-06 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457535+0000", 2024-09-21T13:58:43.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8230000000000002e-06 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502573+0000", 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045037813000000003 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502584+0000", 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1002000000000001e-05 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14335 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457539+0000", 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52653879400000003, 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045093055999999999, 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14335 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457539+0000", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457539+0000", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457539+0000", 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457542+0000", 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.96e-06 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457546+0000", 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2830000000000003e-06 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457554+0000", 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9200000000000004e-06 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502622+0000", 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045068549999999999 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502632+0000", 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7489999999999993e-06 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14336 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457557+0000", 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52652091700000003, 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045124343999999997, 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14336 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457557+0000", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457557+0000", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457557+0000", 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457562+0000", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.079e-06 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457565+0000", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8489999999999999e-06 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457569+0000", 2024-09-21T13:58:43.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.056e-06 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502670+0000", 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045101587999999998 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502681+0000", 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1262e-05 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14337 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457571+0000", 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52650667900000003, 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045150269999999999, 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14337 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457571+0000", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457571+0000", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457571+0000", 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457573+0000", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.491e-06 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457576+0000", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5480000000000002e-06 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457583+0000", 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1520000000000003e-06 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502713+0000", 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045129768000000001 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502722+0000", 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5730000000000008e-06 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.107 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:14338 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.457586+0000", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.52649182100000003, 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045169400999999998, 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 14338 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:43.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457586+0000", 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457586+0000", 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457586+0000", 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457588+0000", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8199999999999999e-06 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457591+0000", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6569999999999999e-06 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.457597+0000", 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6620000000000002e-06 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502746+0000", 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045149277000000002 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502756+0000", 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3710000000000006e-06 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:43.111 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:43.113 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:43.113 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:43.111+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:43.214 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:43.212+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:43.242 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:43.243 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:43.243 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:43.243 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:43.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:43.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:58:43.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:43.347+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:43.415 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:43.415+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:43.446 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:43.446 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:43.446 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:43.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:43.516 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:43.512+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:43.586 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:7663 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:39.016766+0000", 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.5695175490000004, 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052748802999999997, 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7663 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016766+0000", 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016766+0000", 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016764+0000", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016777+0000", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2830000000000001e-05 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016806+0000", 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9632999999999999e-05 2024-09-21T13:58:43.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016823+0000", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6354e-05 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016886+0000", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3567999999999999e-05 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.016959+0000", 2024-09-21T13:58:43.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3294000000000007e-05 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.023949+0000", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069895069999999998 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.069422+0000", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.045473338000000002 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.069433+0000", 2024-09-21T13:58:43.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.065e-05 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.069477+0000", 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3594999999999998e-05 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:39.069515+0000", 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8010999999999999e-05 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13537 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 13438976~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.443634+0000", 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1426491699999999, 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052273142000000002, 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13537 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443634+0000", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443634+0000", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443633+0000", 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443639+0000", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1199999999999999e-06 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443653+0000", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4718e-05 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443671+0000", 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7113999999999999e-05 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.495730+0000", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052059099999999997 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.495811+0000", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1057000000000007e-05 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.495907+0000", 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6601000000000006e-05 2024-09-21T13:58:43.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13539 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 13455360~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.443684+0000", 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1425993139999999, 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052442718999999999, 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13539 2024-09-21T13:58:43.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443684+0000", 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443684+0000", 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443683+0000", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443687+0000", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2980000000000002e-06 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443725+0000", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7327999999999999e-05 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443732+0000", 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0110000000000003e-06 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.495962+0000", 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052230265999999997 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496052+0000", 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0130999999999995e-05 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496127+0000", 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4574999999999997e-05 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13541 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 13471744~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.602 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.443740+0000", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1425433970000001, 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052830984999999997, 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13541 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443740+0000", 2024-09-21T13:58:43.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443740+0000", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443739+0000", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443743+0000", 2024-09-21T13:58:43.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7840000000000001e-06 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443751+0000", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6149999999999999e-06 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443757+0000", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9800000000000003e-06 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496192+0000", 2024-09-21T13:58:43.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052434908000000002 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496337+0000", 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014567099999999999 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496571+0000", 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023360300000000001 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13543 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.443816+0000", 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1424673649999999, 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052841100000000002, 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13543 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443816+0000", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443816+0000", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443815+0000", 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443819+0000", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6059999999999999e-06 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443858+0000", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8957e-05 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443915+0000", 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7438999999999997e-05 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496637+0000", 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052721558000000002 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496657+0000", 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.037e-05 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13545 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.443986+0000", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1422974809999999, 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052722626000000002, 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13545 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443986+0000", 2024-09-21T13:58:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443986+0000", 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443977+0000", 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999914 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.443992+0000", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4768e-05 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444048+0000", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5708999999999998e-05 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444096+0000", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7800000000000003e-05 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496695+0000", 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052598951999999997 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496708+0000", 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.384e-05 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13546 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444189+0000", 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1420941229999999, 2024-09-21T13:58:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052583975999999998, 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13546 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444189+0000", 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444189+0000", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444188+0000", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444195+0000", 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2579999999999998e-06 2024-09-21T13:58:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444216+0000", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1145000000000002e-05 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444231+0000", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5031999999999999e-05 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496759+0000", 2024-09-21T13:58:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052527413000000002 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496773+0000", 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4399999999999999e-05 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13548 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444279+0000", 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1420047499999999, 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052538243999999998, 2024-09-21T13:58:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13548 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444279+0000", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444279+0000", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444278+0000", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444286+0000", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7099999999999996e-06 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444309+0000", 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2818000000000001e-05 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444335+0000", 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5746999999999999e-05 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496804+0000", 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052468977999999999 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496817+0000", 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2944e-05 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13551 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444377+0000", 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.141906401, 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052481579, 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13551 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444377+0000", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444377+0000", 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444376+0000", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444382+0000", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0519999999999998e-06 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444397+0000", 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5142e-05 2024-09-21T13:58:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444408+0000", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1605e-05 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496847+0000", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052438460999999999 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496858+0000", 2024-09-21T13:58:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1639e-05 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13553 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444458+0000", 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1418248289999999, 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052457894999999997, 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13553 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444458+0000", 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444458+0000", 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444457+0000", 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444463+0000", 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6609999999999997e-06 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444478+0000", 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5085e-05 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444490+0000", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.188e-05 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496902+0000", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052411634999999998 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496916+0000", 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.485e-05 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13555 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444526+0000", 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1417573679999999, 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052448956999999997, 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13555 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444526+0000", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444526+0000", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444525+0000", 2024-09-21T13:58:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444542+0000", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6895999999999999e-05 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444558+0000", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5792999999999999e-05 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444570+0000", 2024-09-21T13:58:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1956999999999999e-05 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496964+0000", 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052394435000000003 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.496975+0000", 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0967e-05 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13557 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444618+0000", 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1416651660000001, 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052409257000000001, 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13557 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444618+0000", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444618+0000", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444617+0000", 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444623+0000", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9519999999999999e-06 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444640+0000", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7334e-05 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444654+0000", 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3871e-05 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497015+0000", 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052361023999999999 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497027+0000", 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2447e-05 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13559 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444665+0000", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1416179259999999, 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052381771000000001, 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13559 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444665+0000", 2024-09-21T13:58:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444665+0000", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444664+0000", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444670+0000", 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.395e-06 2024-09-21T13:58:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444684+0000", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4353e-05 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444695+0000", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1022000000000001e-05 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497040+0000", 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052345409000000002 2024-09-21T13:58:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497047+0000", 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7150000000000001e-06 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13692 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444706+0000", 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1415777110000001, 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052390883999999999, 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13692 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444706+0000", 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444706+0000", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444704+0000", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444709+0000", 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0130000000000001e-06 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444725+0000", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5807999999999998e-05 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444737+0000", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1224e-05 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497084+0000", 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052347566999999998 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497096+0000", 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2413e-05 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13696 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444789+0000", 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1414940149999999, 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052323955999999998, 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13696 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444789+0000", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444789+0000", 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444788+0000", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444794+0000", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9549999999999997e-06 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444810+0000", 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702e-05 2024-09-21T13:58:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444821+0000", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1663e-05 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497108+0000", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052286541999999998 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497113+0000", 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2660000000000001e-06 2024-09-21T13:58:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13698 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444832+0000", 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.141450847, 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052315934000000001, 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13698 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444832+0000", 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444832+0000", 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444832+0000", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444836+0000", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9420000000000003e-06 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444849+0000", 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.217e-05 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444860+0000", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1800000000000001e-05 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497137+0000", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052276128999999998 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497148+0000", 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.183e-05 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13700 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444871+0000", 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1414124349999999, 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052293521000000003, 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13700 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444871+0000", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444871+0000", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444870+0000", 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444875+0000", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4750000000000001e-06 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444890+0000", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4697e-05 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444901+0000", 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1007e-05 2024-09-21T13:58:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497159+0000", 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052258594999999998 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497164+0000", 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9740000000000001e-06 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13702 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444911+0000", 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1413722509999999, 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052292269000000002, 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13702 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444911+0000", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444911+0000", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444910+0000", 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444915+0000", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6999999999999999e-06 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444929+0000", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3997e-05 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444940+0000", 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1039999999999999e-05 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497189+0000", 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052249348000000001 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497203+0000", 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4005999999999999e-05 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13704 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.444995+0000", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1412882090000001, 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052258075000000001, 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13704 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444995+0000", 2024-09-21T13:58:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444995+0000", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444994+0000", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.444999+0000", 2024-09-21T13:58:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3850000000000001e-06 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445015+0000", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5338000000000001e-05 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445026+0000", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1822e-05 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497239+0000", 2024-09-21T13:58:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052212388999999998 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497253+0000", 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:13706 3.1a 3.4957e5da (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:42.445106+0000", 2024-09-21T13:58:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.141177522, 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052250075, 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 13706 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445106+0000", 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445106+0000", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445105+0000", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445110+0000", 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3199999999999999e-06 2024-09-21T13:58:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445125+0000", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5031999999999999e-05 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.445136+0000", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.148e-05 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497345+0000", 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05220876 2024-09-21T13:58:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:42.497356+0000", 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0705e-05 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:43.668 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:43.669 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:43.670 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:43.668+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:43.771 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:43.768+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:43.838 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:43.838 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:43.838 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:43.838 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:43.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:43.871 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:43.871+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:43.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:43.972 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:43.971+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:44.015 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:44.015 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:44.015 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:44.015 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:44.015 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:44.029 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:44.041 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:44.041 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:44.059 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:44.059 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:44.073 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:44.072+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:44.075 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:44.075 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:44.091 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:44.091 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:44.111 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:44.111 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:44.131 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:44.131 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:44.150 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:44.151 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:44.151 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:44.151 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:44.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:44.171 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:44.171 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:44.209 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:44.208+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:44.274 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:44.272+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:44.301 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:58:44.338 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:44.338 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:44.354 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:44.397 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:44.396+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:44.476 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:44.472+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:44.524 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:44.524 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:44.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:44.577 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:44.575+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:44.616 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-21T13:58:44.678 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:44.676+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:44.707 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:44.707 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:44.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:58:44.779 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:44.779+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:44.880 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:44.876+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:44.888 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:44.889 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:44.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:58:44.989 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:44.988+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:1472 trunc from 0x6c9cc22 to 0x65f7fc5 2024-09-21T13:58:45.079 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:45.079 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:45.082 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:45.080+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:45.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T13:58:45.182 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:45.183+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:45.283 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:45.283+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:45.307 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:45.308 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:45.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:45.384 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:45.380+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:45.485 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:45.483+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:45.505 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:45.506 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:45.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:45.586 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:45.584+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:45.687 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:45.687+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:45.723 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:45.723 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:45.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:45.826 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:45.827+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:45.888 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:45.887+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:45.932 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:45.932 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:45.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:45.989 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:45.988+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:46.089 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:46.087+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:46.158 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:46.158 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:46.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:46.188 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:46.190 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:46.188+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:46.291 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:46.291+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:46.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:58:46.392 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:46.391+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:46.400 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:46.400 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:46.401 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:46.401 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:46.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:46.423 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:46.423 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:46.459 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:46.459 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:46.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:46.491+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:46.498 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:46.544 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:46.545 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:46.571 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:46.594 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:46.592+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:46.610 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:46.610 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:46.618 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:46.618 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:46.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.782355518999999, 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:58:46.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:58:46.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:46.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:46.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.642332078999999, 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:58:46.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:58:46.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:46.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:58:46.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.614073074, 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:58:46.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:58:46.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.716964529, 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:58:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.71690306, 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.70873231, 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:58:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707839085, 2024-09-21T13:58:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707781324999999, 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:58:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:58:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707762732999999, 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:58:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707750395, 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:58:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707728659000001, 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:58:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707705475999999, 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707685047, 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:58:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707670249, 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:58:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:58:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707645664999999, 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:58:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:58:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707628969, 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:58:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.707606732, 2024-09-21T13:58:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:58:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.789318429, 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:58:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:58:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.619799881, 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.256561287, 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:58:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:58:46.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:46.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:46.717 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:46.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:46.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T13:58:46.719 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T13:58:46.719 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:46.716+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:46.818 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:46.819+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:46.913 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:58:46.913 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:46.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:46.919+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:46.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:47.020 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:47.019+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:47.121 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:58:47.120+0000 7f30db6d4640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26372) UID: 0 2024-09-21T13:58:47.128 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:47.128 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:47.129 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:47.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:47.222 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:47.220+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:47.306 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:47.306 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:58:47.306 INFO:tasks.thrashosds.thrasher:Killing osd 7, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:58:47.306 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T13:58:47.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T13:58:47.323 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:47.323+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:47.329 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:58:47.351 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:47.351 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8321027489999997, 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:58:47.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8319911260000001, 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.357 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:47.361 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8319713029999996, 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:47.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:58:47.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.831947124, 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8319230189999995, 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.371 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8319045100000002, 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:47.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8318947679999997, 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:47.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:58:47.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8318699089999999, 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.385 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8318412320000004, 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:58:47.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8318224140000003, 2024-09-21T13:58:47.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:58:47.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8318017429999998, 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:58:47.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8317806719999998, 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8317448199999999, 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:58:47.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:47.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:58:47.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8317125980000002, 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:58:47.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.417 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8316769580000001, 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8316424800000002, 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:58:47.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8315879200000005, 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:58:47.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:47.430 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.831548755, 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:58:47.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:58:47.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8315100189999995, 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:58:47.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8314852659999996, 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:58:47.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:58:47.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.444 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:47.446 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:47.444+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:47.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:47.546 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:47.547+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:47.647 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:47.644+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:47.668 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59637 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616812+0000", 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038870950000000001, 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038895619999999999, 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59637 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616812+0000", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616812+0000", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.613707+0000", 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9968948 2024-09-21T13:58:47.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616816+0000", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031098430000000002 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616824+0000", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9789999999999993e-06 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616829+0000", 2024-09-21T13:58:47.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8069999999999999e-06 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59669 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617291+0000", 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038392046999999999, 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038482937000000002, 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59669 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617291+0000", 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617291+0000", 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617291+0000", 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617293+0000", 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0169999999999999e-06 2024-09-21T13:58:47.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617298+0000", 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6169999999999998e-06 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617302+0000", 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0679999999999998e-06 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59701 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621172+0000", 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034510396999999998, 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034661809000000002, 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59701 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621172+0000", 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621172+0000", 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621172+0000", 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621174+0000", 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2810000000000001e-06 2024-09-21T13:58:47.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621178+0000", 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9910000000000004e-06 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621180+0000", 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5179999999999999e-06 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.679 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59742 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.629024+0000", 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026659157999999999, 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.026867425, 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.680 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59742 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629024+0000", 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629024+0000", 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629023+0000", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629025+0000", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629028+0000", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629031+0000", 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5830000000000001e-06 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60917 3.18 3:1a366bac:::rbd_data.11853c86949e.0000000000000000:a [read 11345920~2048 out=2048b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.645513+0000", 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.010169864000000001, 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010253689999999999, 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60917 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645513+0000", 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645513+0000", 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645513+0000", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645515+0000", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7659999999999999e-06 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645522+0000", 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6329999999999999e-06 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.645527+0000", 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8740000000000003e-06 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.655607+0000", 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010079909 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:47.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.655679+0000", 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2750999999999995e-05 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.655767+0000", 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7217000000000002e-05 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60949 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646090+0000", 2024-09-21T13:58:47.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.009593173, 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0099133350000000005, 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60949 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646090+0000", 2024-09-21T13:58:47.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646090+0000", 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646089+0000", 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646091+0000", 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.84e-06 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646097+0000", 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4190000000000001e-06 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646101+0000", 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6260000000000003e-06 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60981 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649286+0000", 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063972050000000004, 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0067489510000000004, 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60981 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649286+0000", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649286+0000", 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649285+0000", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649287+0000", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3290000000000001e-06 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649293+0000", 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649298+0000", 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61013 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653066+0000", 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026165139999999999, 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030224190000000001, 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61013 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653066+0000", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653066+0000", 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653066+0000", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653068+0000", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.978e-06 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653073+0000", 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2390000000000002e-06 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653078+0000", 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2889999999999999e-06 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59638 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616834+0000", 2024-09-21T13:58:47.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038848644000000002, 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039330824, 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59638 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616834+0000", 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616834+0000", 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616834+0000", 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616836+0000", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7659999999999999e-06 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616840+0000", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8720000000000001e-06 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616845+0000", 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999996e-06 2024-09-21T13:58:47.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59670 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617307+0000", 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038376277, 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038916933000000001, 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59670 2024-09-21T13:58:47.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617307+0000", 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617307+0000", 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617306+0000", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617308+0000", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1409999999999999e-06 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617314+0000", 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.626e-06 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617318+0000", 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.284e-06 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59702 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621182+0000", 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034500693999999998, 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035096865999999997, 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.704 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59702 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621182+0000", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621182+0000", 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621182+0000", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621183+0000", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2240000000000001e-06 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621186+0000", 2024-09-21T13:58:47.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.864e-06 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621195+0000", 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5720000000000003e-06 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60950 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646105+0000", 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0095776790000000004, 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010230764, 2024-09-21T13:58:47.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60950 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646105+0000", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646105+0000", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646105+0000", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646107+0000", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.03e-06 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646113+0000", 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.682e-06 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646117+0000", 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4170000000000002e-06 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60982 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.710 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649302+0000", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063808520000000002, 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007089031, 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60982 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649302+0000", 2024-09-21T13:58:47.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649302+0000", 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649302+0000", 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649304+0000", 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2699999999999999e-06 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649311+0000", 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9149999999999999e-06 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649315+0000", 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7049999999999998e-06 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61014 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653081+0000", 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026016949999999998, 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033659060000000001, 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61014 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.714 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653081+0000", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653081+0000", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653081+0000", 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653083+0000", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.119e-06 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653088+0000", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3900000000000001e-06 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653093+0000", 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3549999999999998e-06 2024-09-21T13:58:47.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59639 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616849+0000", 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038833461999999999, 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039653980999999998, 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59639 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616849+0000", 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616849+0000", 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616849+0000", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616852+0000", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4830000000000002e-06 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616858+0000", 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.127e-06 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616864+0000", 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0279999999999997e-06 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59671 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617323+0000", 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038359820000000003, 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039237452999999999, 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.720 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59671 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617323+0000", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617323+0000", 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617323+0000", 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617325+0000", 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0719999999999998e-06 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617331+0000", 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4069999999999998e-06 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617335+0000", 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1540000000000004e-06 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59703 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.723 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621197+0000", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034485864999999997, 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035419326000000001, 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59703 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621197+0000", 2024-09-21T13:58:47.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621197+0000", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621197+0000", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621198+0000", 2024-09-21T13:58:47.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.412e-06 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621201+0000", 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0189999999999998e-06 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621204+0000", 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60951 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646121+0000", 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0095620080000000003, 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010556108, 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60951 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646121+0000", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646121+0000", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646120+0000", 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646123+0000", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2199999999999999e-06 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646128+0000", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8259999999999998e-06 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646133+0000", 2024-09-21T13:58:47.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5029999999999999e-06 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60983 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649320+0000", 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063632230000000003, 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074141850000000002, 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60983 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649320+0000", 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649320+0000", 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649319+0000", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649325+0000", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4739999999999996e-06 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649331+0000", 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1430000000000003e-06 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649335+0000", 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61015 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653096+0000", 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0025865390000000001, 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037025550000000002, 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61015 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653096+0000", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653096+0000", 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653096+0000", 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653098+0000", 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2689999999999998e-06 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653104+0000", 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8699999999999997e-06 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653109+0000", 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7700000000000001e-06 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59640 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.736 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616869+0000", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038814224000000001, 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039985492999999997, 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59640 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616869+0000", 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616869+0000", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616868+0000", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616871+0000", 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-21T13:58:47.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616876+0000", 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6899999999999997e-06 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616882+0000", 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59672 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617340+0000", 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038342976000000001, 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039570273000000003, 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59672 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617340+0000", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617340+0000", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617340+0000", 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617342+0000", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-06 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617347+0000", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4820000000000002e-06 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617352+0000", 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7600000000000002e-06 2024-09-21T13:58:47.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59704 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624866+0000", 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030816882, 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032100952000000002, 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59704 2024-09-21T13:58:47.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624866+0000", 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624866+0000", 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621206+0000", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9963398 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624874+0000", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003668349 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624884+0000", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6350000000000001e-06 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624891+0000", 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5680000000000002e-06 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60952 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646137+0000", 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0095460379999999997, 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010864387, 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60952 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646137+0000", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646137+0000", 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646136+0000", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646138+0000", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.029e-06 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646144+0000", 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4020000000000001e-06 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646149+0000", 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60984 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649340+0000", 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063430650000000002, 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00770238, 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60984 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649340+0000", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649340+0000", 2024-09-21T13:58:47.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649339+0000", 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649342+0000", 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2989999999999999e-06 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649348+0000", 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9020000000000004e-06 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649352+0000", 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6079999999999998e-06 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61016 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653113+0000", 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00256982, 2024-09-21T13:58:47.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039737000000000001, 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61016 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653113+0000", 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653113+0000", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653113+0000", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653115+0000", 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653120+0000", 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3990000000000003e-06 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653125+0000", 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3340000000000003e-06 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.755 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59641 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616887+0000", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038796186000000003, 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040230507999999998, 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59641 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616887+0000", 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616887+0000", 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616886+0000", 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616888+0000", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.621e-06 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616891+0000", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3900000000000002e-06 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616894+0000", 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5959999999999998e-06 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59673 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617357+0000", 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038326249999999999, 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039810075, 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59673 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617357+0000", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617357+0000", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617356+0000", 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617358+0000", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1179999999999999e-06 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617364+0000", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7309999999999998e-06 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617369+0000", 2024-09-21T13:58:47.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3279999999999999e-06 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59705 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624902+0000", 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030780624999999999, 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032302653000000001, 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59705 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624902+0000", 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624902+0000", 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624902+0000", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624904+0000", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449999999999999e-06 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624908+0000", 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7749999999999999e-06 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624911+0000", 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9579999999999999e-06 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60953 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646171+0000", 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0095122620000000005, 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011066898, 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60953 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646171+0000", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646171+0000", 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646170+0000", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646173+0000", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5239999999999999e-06 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646179+0000", 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2419999999999997e-06 2024-09-21T13:58:47.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646184+0000", 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4299999999999997e-06 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60985 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649356+0000", 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063263740000000001, 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079288889999999997, 2024-09-21T13:58:47.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60985 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649356+0000", 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649356+0000", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649356+0000", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649358+0000", 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.401e-06 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649364+0000", 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8590000000000001e-06 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649369+0000", 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.476e-06 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.771 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61017 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653128+0000", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0025544560000000001, 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042088769999999998, 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61017 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653128+0000", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653128+0000", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653128+0000", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653130+0000", 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9860000000000001e-06 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653135+0000", 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653140+0000", 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.301e-06 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59642 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616896+0000", 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038786357, 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040505551000000001, 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59642 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616896+0000", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616896+0000", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616896+0000", 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616898+0000", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.967e-06 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616904+0000", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6470000000000003e-06 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616907+0000", 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6910000000000002e-06 2024-09-21T13:58:47.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59674 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617373+0000", 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038310194999999998, 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040086310999999999, 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59674 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617373+0000", 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617373+0000", 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617372+0000", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617374+0000", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9470000000000002e-06 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617380+0000", 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3720000000000004e-06 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617385+0000", 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6239999999999999e-06 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59706 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624913+0000", 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030769802999999998, 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032601455000000001, 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59706 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624913+0000", 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624913+0000", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624913+0000", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624914+0000", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.573e-06 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624917+0000", 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624920+0000", 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5119999999999998e-06 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60954 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646188+0000", 2024-09-21T13:58:47.784 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0094944590000000002, 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011420098, 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60954 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646188+0000", 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646188+0000", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646188+0000", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646190+0000", 2024-09-21T13:58:47.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.278e-06 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646197+0000", 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646202+0000", 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5210000000000004e-06 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60986 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649373+0000", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0063100639999999998, 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082659429999999996, 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60986 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649373+0000", 2024-09-21T13:58:47.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649373+0000", 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649372+0000", 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649375+0000", 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1730000000000002e-06 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649381+0000", 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9190000000000004e-06 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649385+0000", 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.790 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61018 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653144+0000", 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0025389560000000002, 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045246510000000002, 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61018 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.791 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653144+0000", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653144+0000", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653143+0000", 2024-09-21T13:58:47.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653146+0000", 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1229999999999998e-06 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653151+0000", 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1619999999999999e-06 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653155+0000", 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6149999999999999e-06 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59643 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616910+0000", 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038773106000000002, 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040813821, 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59643 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616910+0000", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616910+0000", 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616909+0000", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616915+0000", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8560000000000003e-06 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616921+0000", 2024-09-21T13:58:47.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616926+0000", 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7299999999999996e-06 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59675 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617390+0000", 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038293127000000003, 2024-09-21T13:58:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040368341000000002, 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59675 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617390+0000", 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617390+0000", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617389+0000", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617391+0000", 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.046e-06 2024-09-21T13:58:47.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617398+0000", 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6699999999999997e-06 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617403+0000", 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3490000000000002e-06 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59707 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624922+0000", 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030760686999999998, 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.032870948999999997, 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59707 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624922+0000", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624922+0000", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624922+0000", 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624923+0000", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.333e-06 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624926+0000", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624929+0000", 2024-09-21T13:58:47.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4710000000000001e-06 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60955 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646206+0000", 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.009477124, 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011640487, 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60955 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646206+0000", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646206+0000", 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646205+0000", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646208+0000", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3910000000000001e-06 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646213+0000", 2024-09-21T13:58:47.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000003e-06 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646219+0000", 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.463e-06 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60987 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649389+0000", 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0062934610000000002, 2024-09-21T13:58:47.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085129520000000007, 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60987 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649389+0000", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649389+0000", 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649389+0000", 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649391+0000", 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2869999999999999e-06 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649397+0000", 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7649999999999999e-06 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649401+0000", 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3340000000000003e-06 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61019 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.810 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653199+0000", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024835510000000001, 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047639029999999999, 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61019 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653199+0000", 2024-09-21T13:58:47.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653199+0000", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653199+0000", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653205+0000", 2024-09-21T13:58:47.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653212+0000", 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.737e-06 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653217+0000", 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.169e-06 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59644 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616930+0000", 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038753151, 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041090911000000001, 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59644 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616930+0000", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616930+0000", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616929+0000", 2024-09-21T13:58:47.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616931+0000", 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.018e-06 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616937+0000", 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7060000000000001e-06 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616942+0000", 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6700000000000002e-06 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59676 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617495+0000", 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038187976999999998, 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040582756999999997, 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59676 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617495+0000", 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617495+0000", 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617494+0000", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617498+0000", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8380000000000004e-06 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617518+0000", 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9459000000000001e-05 2024-09-21T13:58:47.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617523+0000", 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4709999999999998e-06 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59708 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624931+0000", 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030752104999999998, 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033182852999999998, 2024-09-21T13:58:47.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59708 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624931+0000", 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624931+0000", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624931+0000", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624932+0000", 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3239999999999999e-06 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624935+0000", 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.818e-06 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624937+0000", 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5220000000000002e-06 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.823 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60956 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646223+0000", 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0094602200000000001, 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011940746, 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60956 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646223+0000", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646223+0000", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646222+0000", 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646224+0000", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.12e-06 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646230+0000", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6350000000000003e-06 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646235+0000", 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4739999999999999e-06 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60988 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649405+0000", 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006277482, 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087891159999999996, 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60988 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.827 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649405+0000", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649405+0000", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649405+0000", 2024-09-21T13:58:47.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649407+0000", 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1150000000000001e-06 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649413+0000", 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9209999999999997e-06 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649417+0000", 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3749999999999996e-06 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61020 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653221+0000", 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024615520000000001, 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050116090000000002, 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61020 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653221+0000", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653221+0000", 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653221+0000", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653223+0000", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2840000000000001e-06 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653228+0000", 2024-09-21T13:58:47.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.356e-06 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653233+0000", 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59645 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616946+0000", 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038736962, 2024-09-21T13:58:47.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041339296999999997, 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59645 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616946+0000", 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616946+0000", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616945+0000", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616947+0000", 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.007e-06 2024-09-21T13:58:47.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616953+0000", 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.468e-06 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616957+0000", 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4179999999999999e-06 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59677 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617528+0000", 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038154857, 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040785834, 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59677 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617528+0000", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617528+0000", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617528+0000", 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617530+0000", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6410000000000002e-06 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617536+0000", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7189999999999998e-06 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617541+0000", 2024-09-21T13:58:47.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8919999999999999e-06 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59709 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624939+0000", 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030743604000000001, 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033428270000000003, 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59709 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624939+0000", 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624939+0000", 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624939+0000", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624940+0000", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624943+0000", 2024-09-21T13:58:47.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8229999999999999e-06 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624946+0000", 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9890000000000001e-06 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60957 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646238+0000", 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0094446719999999994, 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012179689, 2024-09-21T13:58:47.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60957 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646238+0000", 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646238+0000", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646238+0000", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646240+0000", 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.385e-06 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646246+0000", 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.071e-06 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646251+0000", 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5029999999999999e-06 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60989 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649422+0000", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0062612880000000003, 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090538719999999993, 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60989 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649422+0000", 2024-09-21T13:58:47.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649422+0000", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649421+0000", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649423+0000", 2024-09-21T13:58:47.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1500000000000002e-06 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649429+0000", 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7459999999999997e-06 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649434+0000", 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8230000000000002e-06 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61021 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653237+0000", 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024457469999999999, 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052934820000000004, 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61021 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653237+0000", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653237+0000", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653237+0000", 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653239+0000", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1739999999999999e-06 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653244+0000", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5509999999999999e-06 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653249+0000", 2024-09-21T13:58:47.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59646 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616962+0000", 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038721301999999999, 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041633668999999998, 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.853 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59646 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616962+0000", 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616962+0000", 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616961+0000", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616963+0000", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0509999999999999e-06 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616969+0000", 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5639999999999996e-06 2024-09-21T13:58:47.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616974+0000", 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7280000000000003e-06 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59678 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617545+0000", 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038138235999999999, 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041087066999999998, 2024-09-21T13:58:47.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59678 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617545+0000", 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617545+0000", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617544+0000", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617546+0000", 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5540000000000001e-06 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617550+0000", 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9759999999999997e-06 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617553+0000", 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.712e-06 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.859 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59710 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.860 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624949+0000", 2024-09-21T13:58:47.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030733869, 2024-09-21T13:58:47.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033730976000000003, 2024-09-21T13:58:47.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59710 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624949+0000", 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624949+0000", 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624949+0000", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624950+0000", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2330000000000001e-06 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624953+0000", 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7989999999999998e-06 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624955+0000", 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4219999999999999e-06 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60958 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646376+0000", 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0093070389999999996, 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012342245999999999, 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60958 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646376+0000", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646376+0000", 2024-09-21T13:58:47.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646254+0000", 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998789 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646379+0000", 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012419699999999999 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646388+0000", 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8449999999999992e-06 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646393+0000", 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6060000000000002e-06 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60990 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649447+0000", 2024-09-21T13:58:47.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006236236, 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092998590000000006, 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60990 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649447+0000", 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649447+0000", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649446+0000", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649449+0000", 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5689999999999999e-06 2024-09-21T13:58:47.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649457+0000", 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9510000000000006e-06 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649462+0000", 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9609999999999996e-06 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61022 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653255+0000", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024283180000000001, 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055428609999999996, 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61022 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653255+0000", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653255+0000", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653254+0000", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653256+0000", 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.08e-06 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653262+0000", 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7180000000000001e-06 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653267+0000", 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5179999999999998e-06 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59647 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616978+0000", 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038705255000000001, 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041856669999999999, 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59647 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616978+0000", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616978+0000", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616977+0000", 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616979+0000", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2479999999999999e-06 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616988+0000", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2570000000000007e-06 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616993+0000", 2024-09-21T13:58:47.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.865e-06 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59679 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620900+0000", 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034783152999999997, 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037965076, 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59679 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620900+0000", 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620900+0000", 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617555+0000", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.996655 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620908+0000", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033534419999999999 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620919+0000", 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964999999999999e-05 2024-09-21T13:58:47.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620924+0000", 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3940000000000004e-06 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59711 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624957+0000", 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030725595000000001, 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033959536999999998, 2024-09-21T13:58:47.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59711 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624957+0000", 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624957+0000", 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624957+0000", 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624958+0000", 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2810000000000001e-06 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624961+0000", 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8650000000000001e-06 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624964+0000", 2024-09-21T13:58:47.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60959 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646398+0000", 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0092847610000000007, 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012574602000000001, 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60959 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646398+0000", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646398+0000", 2024-09-21T13:58:47.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646398+0000", 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646403+0000", 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5480000000000001e-06 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646409+0000", 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5609999999999998e-06 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646414+0000", 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60991 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649466+0000", 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0062169740000000001, 2024-09-21T13:58:47.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095626080000000002, 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60991 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649466+0000", 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649466+0000", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649465+0000", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649468+0000", 2024-09-21T13:58:47.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3630000000000001e-06 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649474+0000", 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.02e-06 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649478+0000", 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5340000000000001e-06 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61023 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653271+0000", 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0024123529999999999, 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058165650000000001, 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61023 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653271+0000", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653271+0000", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653270+0000", 2024-09-21T13:58:47.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653273+0000", 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7259999999999998e-06 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653279+0000", 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5259999999999999e-06 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653284+0000", 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6290000000000001e-06 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59648 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.616997+0000", 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038686064999999999, 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042150805, 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59648 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616997+0000", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616997+0000", 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616996+0000", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.616999+0000", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.114e-06 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617005+0000", 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3729999999999998e-06 2024-09-21T13:58:47.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617010+0000", 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7759999999999997e-06 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59680 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620929+0000", 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034753744000000003, 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038328363999999997, 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59680 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620929+0000", 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620929+0000", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620929+0000", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620931+0000", 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.984e-06 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620936+0000", 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.057e-06 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620939+0000", 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9100000000000001e-06 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59712 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624966+0000", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030717176999999998, 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034321703000000002, 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59712 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624966+0000", 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624966+0000", 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624965+0000", 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624967+0000", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3230000000000001e-06 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624970+0000", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7700000000000002e-06 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624972+0000", 2024-09-21T13:58:47.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4549999999999998e-06 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60960 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.646418+0000", 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0092646399999999993, 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012912619, 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60960 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646418+0000", 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646418+0000", 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646418+0000", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646420+0000", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646426+0000", 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5029999999999997e-06 2024-09-21T13:58:47.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646430+0000", 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3340000000000003e-06 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60992 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649482+0000", 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0062005990000000002, 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0098775579999999998, 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60992 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649482+0000", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649482+0000", 2024-09-21T13:58:47.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649482+0000", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649484+0000", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1019999999999999e-06 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649490+0000", 2024-09-21T13:58:47.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7869999999999998e-06 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649495+0000", 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7040000000000002e-06 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61024 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653289+0000", 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0023936040000000001, 2024-09-21T13:58:47.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060982600000000003, 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61024 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653289+0000", 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653289+0000", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653289+0000", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653291+0000", 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0640000000000001e-06 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653297+0000", 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7089999999999999e-06 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653301+0000", 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6530000000000002e-06 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59649 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617014+0000", 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038669166999999997, 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042414650999999998, 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59649 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617014+0000", 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617014+0000", 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617013+0000", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617015+0000", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.148e-06 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617021+0000", 2024-09-21T13:58:47.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.75e-06 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617028+0000", 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3319999999999997e-06 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59681 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620951+0000", 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034732303999999999, 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038507398999999998, 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59681 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620951+0000", 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620951+0000", 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620950+0000", 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620952+0000", 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8250000000000001e-06 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620956+0000", 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9369999999999997e-06 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620959+0000", 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6730000000000001e-06 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59713 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624974+0000", 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030708853000000001, 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034522311, 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59713 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624974+0000", 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624974+0000", 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624974+0000", 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624975+0000", 2024-09-21T13:58:47.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624983+0000", 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5480000000000004e-06 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624986+0000", 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1480000000000002e-06 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60961 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.648909+0000", 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0067736419999999999, 2024-09-21T13:58:47.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010641909, 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60961 2024-09-21T13:58:47.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648909+0000", 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648909+0000", 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.646433+0000", 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9975243 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648914+0000", 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024809189999999998 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648927+0000", 2024-09-21T13:58:47.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2996999999999999e-05 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648935+0000", 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60993 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649499+0000", 2024-09-21T13:58:47.939 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0061842759999999998, 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010111866000000001, 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60993 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649499+0000", 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649499+0000", 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649498+0000", 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649500+0000", 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2630000000000002e-06 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649506+0000", 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8309999999999997e-06 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649511+0000", 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3669999999999999e-06 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.944 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61025 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653305+0000", 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002377564, 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063606870000000003, 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61025 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653305+0000", 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653305+0000", 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653305+0000", 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653307+0000", 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.537e-06 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653313+0000", 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6720000000000001e-06 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653318+0000", 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3070000000000002e-06 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59650 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617034+0000", 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038649076999999997, 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042688464000000002, 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59650 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617034+0000", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617034+0000", 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617033+0000", 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617035+0000", 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0660000000000002e-06 2024-09-21T13:58:47.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617041+0000", 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3190000000000002e-06 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617045+0000", 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0999999999999997e-06 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59682 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620962+0000", 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034721055000000001, 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038791639000000003, 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59682 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620962+0000", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620962+0000", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620962+0000", 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620963+0000", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9309999999999998e-06 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620969+0000", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8119999999999996e-06 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620974+0000", 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3080000000000001e-06 2024-09-21T13:58:47.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59714 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.624989+0000", 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030693642, 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034802264999999999, 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59714 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624989+0000", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624989+0000", 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624989+0000", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.624991+0000", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1799999999999999e-06 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625005+0000", 2024-09-21T13:58:47.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3725e-05 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625012+0000", 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8070000000000002e-06 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60962 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.648943+0000", 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006740172, 2024-09-21T13:58:47.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010877269, 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60962 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648943+0000", 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648943+0000", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648942+0000", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648945+0000", 2024-09-21T13:58:47.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1070000000000001e-06 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648952+0000", 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1350000000000003e-06 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648959+0000", 2024-09-21T13:58:47.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.815e-06 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60994 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649515+0000", 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0061677679999999997, 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01033531, 2024-09-21T13:58:47.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60994 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649515+0000", 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649515+0000", 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649515+0000", 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649517+0000", 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.407e-06 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649523+0000", 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8449999999999999e-06 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649527+0000", 2024-09-21T13:58:47.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.454e-06 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61026 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653322+0000", 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0023604350000000001, 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065658519999999996, 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61026 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653322+0000", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653322+0000", 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653322+0000", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653324+0000", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1009999999999999e-06 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653330+0000", 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6280000000000002e-06 2024-09-21T13:58:47.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653334+0000", 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4240000000000003e-06 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59651 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617049+0000", 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038634015000000001, 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042872407000000001, 2024-09-21T13:58:47.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59651 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617049+0000", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617049+0000", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617048+0000", 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617051+0000", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.238e-06 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617056+0000", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4790000000000004e-06 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617062+0000", 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7729999999999996e-06 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59683 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620978+0000", 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034705166000000003, 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038973688999999999, 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59683 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.974 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620978+0000", 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620978+0000", 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620977+0000", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620980+0000", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.227e-06 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620985+0000", 2024-09-21T13:58:47.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6049999999999997e-06 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620989+0000", 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.817e-06 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59715 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625015+0000", 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030668285, 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034971407000000003, 2024-09-21T13:58:47.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59715 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625015+0000", 2024-09-21T13:58:47.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625015+0000", 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625014+0000", 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625016+0000", 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7659999999999999e-06 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625019+0000", 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3739999999999998e-06 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625023+0000", 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.145e-06 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60963 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.648964+0000", 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0067187480000000001, 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011054384, 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60963 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648964+0000", 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648964+0000", 2024-09-21T13:58:47.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648964+0000", 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648966+0000", 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648972+0000", 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1319999999999999e-06 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648979+0000", 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.392e-06 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60995 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649531+0000", 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0061515160000000001, 2024-09-21T13:58:47.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010516635999999999, 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60995 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649531+0000", 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649531+0000", 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649531+0000", 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649537+0000", 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649543+0000", 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649548+0000", 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8910000000000003e-06 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61027 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653338+0000", 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002344802, 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006764768, 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61027 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653338+0000", 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653338+0000", 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653338+0000", 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653340+0000", 2024-09-21T13:58:47.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2069999999999998e-06 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653346+0000", 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0499999999999997e-06 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653350+0000", 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4139999999999996e-06 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59652 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617066+0000", 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038616868999999998, 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043094459000000002, 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59652 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617066+0000", 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617066+0000", 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617066+0000", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617068+0000", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0839999999999999e-06 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617075+0000", 2024-09-21T13:58:47.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8229999999999997e-06 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617079+0000", 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3229999999999999e-06 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59684 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.620991+0000", 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034691451999999998, 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039227761999999999, 2024-09-21T13:58:47.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59684 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620991+0000", 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620991+0000", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620991+0000", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620993+0000", 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3999999999999999e-06 2024-09-21T13:58:47.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620996+0000", 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.620998+0000", 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5720000000000001e-06 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:47.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59716 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625026+0000", 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030656383999999998, 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035247782999999998, 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59716 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:47.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625026+0000", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625026+0000", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625026+0000", 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625032+0000", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5740000000000003e-06 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625038+0000", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0410000000000003e-06 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625042+0000", 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.549e-06 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60964 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.648983+0000", 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006699389, 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011330757, 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60964 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.002 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648983+0000", 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648983+0000", 2024-09-21T13:58:48.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648983+0000", 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648986+0000", 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6539999999999999e-06 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648992+0000", 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8919999999999997e-06 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.648996+0000", 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7389999999999999e-06 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60996 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649552+0000", 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0061307269999999999, 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010795831000000001, 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60996 2024-09-21T13:58:48.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649552+0000", 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649552+0000", 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649552+0000", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649554+0000", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3159999999999999e-06 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649560+0000", 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8300000000000001e-06 2024-09-21T13:58:48.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649564+0000", 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4789999999999998e-06 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61028 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653354+0000", 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002328817, 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070234479999999998, 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61028 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653354+0000", 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653354+0000", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653354+0000", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653356+0000", 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1849999999999998e-06 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653361+0000", 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5849999999999999e-06 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653366+0000", 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2740000000000001e-06 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.012 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59653 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617083+0000", 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038599976000000001, 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043323569999999999, 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59653 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.013 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617083+0000", 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617083+0000", 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617082+0000", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617085+0000", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2280000000000001e-06 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617091+0000", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.212e-06 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617096+0000", 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6759999999999998e-06 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59685 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621000+0000", 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034682602, 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039455364, 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59685 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621000+0000", 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621000+0000", 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621000+0000", 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621001+0000", 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2249999999999999e-06 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621004+0000", 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9019999999999999e-06 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621007+0000", 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6010000000000002e-06 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59717 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625047+0000", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030635895999999999, 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035469187999999999, 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59717 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625047+0000", 2024-09-21T13:58:48.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625047+0000", 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625046+0000", 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625049+0000", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4820000000000001e-06 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625052+0000", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625055+0000", 2024-09-21T13:58:48.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60965 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649001+0000", 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0066821909999999997, 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011570778, 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60965 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649001+0000", 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649001+0000", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649000+0000", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649003+0000", 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6570000000000001e-06 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649009+0000", 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.241e-06 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649015+0000", 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0430000000000004e-06 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.026 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60997 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649568+0000", 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0061145640000000003, 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011062193999999999, 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60997 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649568+0000", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649568+0000", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649568+0000", 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649570+0000", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1679999999999998e-06 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649576+0000", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6500000000000001e-06 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649580+0000", 2024-09-21T13:58:48.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5630000000000002e-06 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61029 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653369+0000", 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002313393, 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00731681, 2024-09-21T13:58:48.030 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61029 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653369+0000", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653369+0000", 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653369+0000", 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653371+0000", 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.311e-06 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653377+0000", 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.57e-06 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653382+0000", 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5510000000000001e-06 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59654 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617111+0000", 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038572242999999999, 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043618508, 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59654 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617111+0000", 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617111+0000", 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617110+0000", 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617112+0000", 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7090000000000001e-06 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617116+0000", 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.631e-06 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617119+0000", 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4589999999999998e-06 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59686 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621009+0000", 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034673886000000001, 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039794797, 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59686 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621009+0000", 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621009+0000", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621009+0000", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621010+0000", 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1689999999999999e-06 2024-09-21T13:58:48.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621013+0000", 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9079999999999999e-06 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621015+0000", 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3e-06 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59718 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625064+0000", 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030619212999999999, 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035773755999999997, 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59718 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625064+0000", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625064+0000", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625063+0000", 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625065+0000", 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4309999999999999e-06 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625068+0000", 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.202e-06 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625071+0000", 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6579999999999998e-06 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60966 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649019+0000", 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0066635100000000001, 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011870996999999999, 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60966 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649019+0000", 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649019+0000", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649019+0000", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649021+0000", 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3819999999999998e-06 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649028+0000", 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1230000000000002e-06 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649034+0000", 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.767e-06 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60998 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649585+0000", 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.006098249, 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011363968, 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60998 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649585+0000", 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649585+0000", 2024-09-21T13:58:48.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649584+0000", 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649587+0000", 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.452e-06 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649593+0000", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649598+0000", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1270000000000002e-06 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61030 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653386+0000", 2024-09-21T13:58:48.051 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0022971530000000001, 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076194369999999997, 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61030 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653386+0000", 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653386+0000", 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653385+0000", 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653387+0000", 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2259999999999999e-06 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653393+0000", 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5600000000000001e-06 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653397+0000", 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3769999999999998e-06 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59655 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617121+0000", 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038561443000000001, 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043941118000000001, 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59655 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617121+0000", 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617121+0000", 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617121+0000", 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617125+0000", 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T13:58:48.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617128+0000", 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.067e-06 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617131+0000", 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6280000000000001e-06 2024-09-21T13:58:48.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59687 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621017+0000", 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034665667999999997, 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040105439, 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59687 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621017+0000", 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621017+0000", 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621017+0000", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621018+0000", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.161e-06 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621021+0000", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9220000000000001e-06 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621024+0000", 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4660000000000002e-06 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59719 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625073+0000", 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030610035000000001, 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036082361, 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.062 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59719 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625073+0000", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625073+0000", 2024-09-21T13:58:48.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625073+0000", 2024-09-21T13:58:48.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625074+0000", 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625077+0000", 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8100000000000002e-06 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625079+0000", 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.508e-06 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60967 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649039+0000", 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0066443259999999999, 2024-09-21T13:58:48.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012156858, 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60967 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649039+0000", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649039+0000", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649038+0000", 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649041+0000", 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649048+0000", 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.452e-06 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649053+0000", 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7609999999999998e-06 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60999 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649602+0000", 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0060810049999999996, 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011622782, 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60999 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649602+0000", 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649602+0000", 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649602+0000", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649604+0000", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1950000000000002e-06 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649609+0000", 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7010000000000001e-06 2024-09-21T13:58:48.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649614+0000", 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6330000000000004e-06 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61031 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653401+0000", 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0022814139999999998, 2024-09-21T13:58:48.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078529649999999999, 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61031 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653401+0000", 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653401+0000", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653401+0000", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653403+0000", 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2010000000000002e-06 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653409+0000", 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6330000000000001e-06 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653413+0000", 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5530000000000003e-06 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59656 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617133+0000", 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038549405000000002, 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044161749, 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59656 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617133+0000", 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617133+0000", 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617133+0000", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617134+0000", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3430000000000001e-06 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617137+0000", 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.864e-06 2024-09-21T13:58:48.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617140+0000", 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5280000000000002e-06 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59688 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621026+0000", 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034657224, 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040301497999999998, 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.081 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59688 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621026+0000", 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621026+0000", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621025+0000", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621027+0000", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.234e-06 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621030+0000", 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.915e-06 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621032+0000", 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5390000000000002e-06 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59720 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625081+0000", 2024-09-21T13:58:48.084 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030601579, 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036273652000000003, 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59720 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625081+0000", 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625081+0000", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625081+0000", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625082+0000", 2024-09-21T13:58:48.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.336e-06 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625085+0000", 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.818e-06 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625090+0000", 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4410000000000003e-06 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60968 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649057+0000", 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0066262400000000003, 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012336554, 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60968 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649057+0000", 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649057+0000", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649056+0000", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649058+0000", 2024-09-21T13:58:48.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2000000000000001e-06 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649064+0000", 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7810000000000002e-06 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649069+0000", 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4880000000000001e-06 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61000 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649619+0000", 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0060635139999999999, 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011803042999999999, 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61000 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.092 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649619+0000", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649619+0000", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649619+0000", 2024-09-21T13:58:48.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649621+0000", 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2840000000000001e-06 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649629+0000", 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649633+0000", 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7380000000000002e-06 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61032 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653420+0000", 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0022630049999999998, 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080578149999999994, 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61032 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653420+0000", 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653420+0000", 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653419+0000", 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653422+0000", 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2170000000000001e-06 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653428+0000", 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7499999999999997e-06 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653433+0000", 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5630000000000002e-06 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59657 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617142+0000", 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038540936999999997, 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044396232000000001, 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59657 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617142+0000", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617142+0000", 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617142+0000", 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617143+0000", 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.466e-06 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617147+0000", 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.36e-06 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617149+0000", 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5229999999999998e-06 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59689 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621034+0000", 2024-09-21T13:58:48.102 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034648745000000002, 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040560614000000002, 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59689 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621034+0000", 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621034+0000", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621034+0000", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621036+0000", 2024-09-21T13:58:48.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7999999999999999e-06 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621042+0000", 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9329999999999998e-06 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621045+0000", 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2260000000000001e-06 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59721 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625093+0000", 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030589390000000001, 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036560082000000001, 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59721 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625093+0000", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625093+0000", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625093+0000", 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625095+0000", 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1409999999999999e-06 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625102+0000", 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3879999999999997e-06 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625106+0000", 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2300000000000002e-06 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60969 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.109 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649072+0000", 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0066104049999999998, 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012610546, 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60969 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649072+0000", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649072+0000", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649072+0000", 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649074+0000", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3080000000000002e-06 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649080+0000", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.75e-06 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649086+0000", 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8680000000000004e-06 2024-09-21T13:58:48.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61001 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652857+0000", 2024-09-21T13:58:48.113 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0028255889999999999, 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088655269999999998, 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61001 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652857+0000", 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652857+0000", 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649638+0000", 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9967809 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652862+0000", 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032243200000000001 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652871+0000", 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7649999999999999e-06 2024-09-21T13:58:48.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652878+0000", 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5520000000000001e-06 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61033 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656819+0000", 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9988642, 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049333220000000004, 2024-09-21T13:58:48.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61033 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656819+0000", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656819+0000", 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653437+0000", 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9966183 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656824+0000", 2024-09-21T13:58:48.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033869009999999999 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656834+0000", 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0203e-05 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656841+0000", 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0119999999999999e-06 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59658 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617151+0000", 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038531685000000003, 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044632081999999997, 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59658 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617151+0000", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617151+0000", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617151+0000", 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617152+0000", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.364e-06 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617155+0000", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8389999999999998e-06 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617158+0000", 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4250000000000001e-06 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59690 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621047+0000", 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034635752999999998, 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040775174999999997, 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59690 2024-09-21T13:58:48.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621047+0000", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621047+0000", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621047+0000", 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621048+0000", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3510000000000001e-06 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621051+0000", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.869e-06 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621054+0000", 2024-09-21T13:58:48.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4710000000000001e-06 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59722 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625111+0000", 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030571844000000001, 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036743544000000003, 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59722 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625111+0000", 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625111+0000", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625111+0000", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625113+0000", 2024-09-21T13:58:48.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1770000000000001e-06 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625117+0000", 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4959999999999998e-06 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625120+0000", 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60970 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649090+0000", 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00659283, 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012792562, 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60970 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649090+0000", 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649090+0000", 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649090+0000", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649092+0000", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1229999999999998e-06 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649098+0000", 2024-09-21T13:58:48.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.699e-06 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649102+0000", 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5759999999999999e-06 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61002 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652884+0000", 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0027988309999999999, 2024-09-21T13:58:48.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090282820000000003, 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61002 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652884+0000", 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652884+0000", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652883+0000", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652887+0000", 2024-09-21T13:58:48.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0189999999999998e-06 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652893+0000", 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1129999999999997e-06 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652898+0000", 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1909999999999999e-06 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61034 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656885+0000", 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9987984, 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050648309999999997, 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61034 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656885+0000", 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656885+0000", 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656884+0000", 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656888+0000", 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.54e-06 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656896+0000", 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3909999999999998e-06 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656903+0000", 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59659 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617160+0000", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038523244999999998, 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044836484000000003, 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59659 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617160+0000", 2024-09-21T13:58:48.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617160+0000", 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617159+0000", 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617161+0000", 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2279999999999999e-06 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617163+0000", 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8490000000000002e-06 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617166+0000", 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.373e-06 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59691 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621056+0000", 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034627133999999997, 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040996009, 2024-09-21T13:58:48.148 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59691 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621056+0000", 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621056+0000", 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621056+0000", 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621057+0000", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2100000000000001e-06 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621060+0000", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8899999999999999e-06 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621062+0000", 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3539999999999998e-06 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59723 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625122+0000", 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030560548, 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036985173000000003, 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59723 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625122+0000", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625122+0000", 2024-09-21T13:58:48.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625122+0000", 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625123+0000", 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.344e-06 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625126+0000", 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8219999999999998e-06 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625129+0000", 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8940000000000002e-06 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60971 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.155 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649106+0000", 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0065769560000000001, 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013059183, 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60971 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649106+0000", 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649106+0000", 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649106+0000", 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649111+0000", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7780000000000004e-06 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649126+0000", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4803999999999999e-05 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649131+0000", 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2279999999999998e-06 2024-09-21T13:58:48.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61003 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652902+0000", 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00278086, 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093028690000000001, 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61003 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652902+0000", 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652902+0000", 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652902+0000", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652904+0000", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3910000000000001e-06 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652910+0000", 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5910000000000003e-06 2024-09-21T13:58:48.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652914+0000", 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4920000000000004e-06 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.162 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61035 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656908+0000", 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.998775, 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054438079999999996, 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61035 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656908+0000", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656908+0000", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656908+0000", 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656910+0000", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2510000000000001e-06 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656916+0000", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2530000000000001e-06 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656921+0000", 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5680000000000001e-06 2024-09-21T13:58:48.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59660 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617168+0000", 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038514892000000002, 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045244117, 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59660 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617168+0000", 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617168+0000", 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617168+0000", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617169+0000", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.15e-06 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617172+0000", 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3459999999999998e-06 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617175+0000", 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3939999999999999e-06 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59692 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621067+0000", 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034615783999999997, 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041406331999999997, 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59692 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621067+0000", 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621067+0000", 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621067+0000", 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621068+0000", 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.505e-06 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621071+0000", 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.055e-06 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621074+0000", 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4540000000000001e-06 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59724 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.172 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625131+0000", 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030551509000000001, 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037398237000000001, 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59724 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625131+0000", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625131+0000", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625131+0000", 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625132+0000", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-06 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625135+0000", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.796e-06 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625138+0000", 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60972 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649136+0000", 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0065465990000000002, 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013450699999999999, 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60972 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.176 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649136+0000", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649136+0000", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649136+0000", 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649138+0000", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.689e-06 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649145+0000", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3350000000000003e-06 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649150+0000", 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6979999999999997e-06 2024-09-21T13:58:48.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61004 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652918+0000", 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0027647739999999998, 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096995269999999995, 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61004 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.179 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652918+0000", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652918+0000", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652918+0000", 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652920+0000", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2759999999999999e-06 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652925+0000", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3839999999999996e-06 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652929+0000", 2024-09-21T13:58:48.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0609999999999997e-06 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61036 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656925+0000", 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9987578, 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057227759999999997, 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.182 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61036 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656925+0000", 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656925+0000", 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656925+0000", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656927+0000", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.221e-06 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656934+0000", 2024-09-21T13:58:48.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9330000000000004e-06 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656938+0000", 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5669999999999996e-06 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59661 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617177+0000", 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038506085000000002, 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045507356999999998, 2024-09-21T13:58:48.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59661 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617177+0000", 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617177+0000", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617177+0000", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617178+0000", 2024-09-21T13:58:48.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.15e-06 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617181+0000", 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8310000000000001e-06 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617183+0000", 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8550000000000002e-06 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59693 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621083+0000", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034600268000000003, 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041654682999999998, 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59693 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621083+0000", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621083+0000", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621082+0000", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621084+0000", 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.686e-06 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621087+0000", 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.269e-06 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621090+0000", 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5550000000000001e-06 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59726 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.625140+0000", 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.030543167999999999, 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03764522, 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59726 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625140+0000", 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625140+0000", 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625139+0000", 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625141+0000", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699999999999999e-06 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625144+0000", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2559999999999998e-06 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625146+0000", 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.43e-06 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60973 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649154+0000", 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0065288530000000003, 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013679314, 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60973 2024-09-21T13:58:48.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649154+0000", 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649154+0000", 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649153+0000", 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649156+0000", 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4710000000000001e-06 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649162+0000", 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7729999999999996e-06 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649166+0000", 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3089999999999997e-06 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61005 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652933+0000", 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002749362, 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.009955841, 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.199 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61005 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652933+0000", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652933+0000", 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652933+0000", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652936+0000", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7889999999999999e-06 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652942+0000", 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6690000000000003e-06 2024-09-21T13:58:48.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652947+0000", 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6509999999999998e-06 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61037 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656942+0000", 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9987407, 2024-09-21T13:58:48.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060030789999999997, 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61037 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656942+0000", 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656942+0000", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656942+0000", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656944+0000", 2024-09-21T13:58:48.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2180000000000002e-06 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656951+0000", 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5400000000000001e-06 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656956+0000", 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.797e-06 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.205 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59662 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617186+0000", 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038496555000000002, 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045822633000000002, 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59662 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.206 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617186+0000", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617186+0000", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617186+0000", 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617187+0000", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1990000000000001e-06 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617190+0000", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9000000000000002e-06 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617193+0000", 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4250000000000001e-06 2024-09-21T13:58:48.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59694 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621092+0000", 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034590925000000002, 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041971187, 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59694 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621092+0000", 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621092+0000", 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621092+0000", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621093+0000", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1999999999999999e-06 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621098+0000", 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1250000000000001e-06 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621102+0000", 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1860000000000002e-06 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59728 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.628918+0000", 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026764926000000001, 2024-09-21T13:58:48.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034176274999999999, 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59728 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628918+0000", 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628918+0000", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.625148+0000", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9962306 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628922+0000", 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037740130000000001 2024-09-21T13:58:48.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628931+0000", 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.49e-06 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628936+0000", 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0159999999999999e-06 2024-09-21T13:58:48.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60974 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649170+0000", 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0065128410000000001, 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013952378, 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.216 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60974 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649170+0000", 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649170+0000", 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649170+0000", 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649172+0000", 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.12e-06 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649178+0000", 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9370000000000001e-06 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649182+0000", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2989999999999998e-06 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61006 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652951+0000", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0027314650000000002, 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010200740999999999, 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61006 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652951+0000", 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652951+0000", 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652951+0000", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652953+0000", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.21e-06 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652959+0000", 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.519e-06 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652963+0000", 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3710000000000002e-06 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61038 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656960+0000", 2024-09-21T13:58:48.222 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.998723, 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062202849999999999, 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61038 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656960+0000", 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656960+0000", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656959+0000", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656962+0000", 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5349999999999999e-06 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656968+0000", 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.852e-06 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656972+0000", 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5020000000000003e-06 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59663 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617195+0000", 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038488203999999998, 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046018542000000003, 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59663 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.226 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617195+0000", 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617195+0000", 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617194+0000", 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617196+0000", 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2890000000000001e-06 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617199+0000", 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.802e-06 2024-09-21T13:58:48.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617201+0000", 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59695 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621106+0000", 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034576498999999997, 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042134474999999998, 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.231 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59695 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621106+0000", 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621106+0000", 2024-09-21T13:58:48.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621106+0000", 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621108+0000", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2670000000000001e-06 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621115+0000", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7190000000000004e-06 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621120+0000", 2024-09-21T13:58:48.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5589999999999999e-06 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59730 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.628953+0000", 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026729902999999999, 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034317458000000002, 2024-09-21T13:58:48.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59730 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628953+0000", 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628953+0000", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628953+0000", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628955+0000", 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0789999999999999e-06 2024-09-21T13:58:48.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628958+0000", 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8160000000000004e-06 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628963+0000", 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.481e-06 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.239 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60975 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649186+0000", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064967100000000002, 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014134416, 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60975 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649186+0000", 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649186+0000", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649186+0000", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649188+0000", 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4789999999999999e-06 2024-09-21T13:58:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649194+0000", 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649199+0000", 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5410000000000002e-06 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61007 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652967+0000", 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00271595, 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01040958, 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61007 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652967+0000", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652967+0000", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652967+0000", 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652973+0000", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7569999999999998e-06 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652979+0000", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6960000000000002e-06 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652983+0000", 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2209999999999999e-06 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61039 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.656977+0000", 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9987054, 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064590710000000003, 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61039 2024-09-21T13:58:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656977+0000", 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656977+0000", 2024-09-21T13:58:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656977+0000", 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656979+0000", 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3750000000000001e-06 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656985+0000", 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9859999999999999e-06 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.656990+0000", 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7400000000000004e-06 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59664 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617203+0000", 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.03847971, 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046282849000000001, 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59664 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617203+0000", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617203+0000", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617203+0000", 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617204+0000", 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1909999999999999e-06 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617207+0000", 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7999999999999999e-06 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617210+0000", 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.207e-06 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59696 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621123+0000", 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034559648999999998, 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042394044999999998, 2024-09-21T13:58:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59696 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621123+0000", 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621123+0000", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621123+0000", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621125+0000", 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.764e-06 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621133+0000", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4349999999999997e-06 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621136+0000", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7460000000000001e-06 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59732 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.628967+0000", 2024-09-21T13:58:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026715447, 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034577812999999999, 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59732 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628967+0000", 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628967+0000", 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628967+0000", 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628973+0000", 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9519999999999999e-06 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628980+0000", 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6019999999999996e-06 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628983+0000", 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0199999999999999e-06 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60976 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649203+0000", 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064797300000000004, 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014371045000000001, 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60976 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649203+0000", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649203+0000", 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649203+0000", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649205+0000", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.283e-06 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649211+0000", 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5319999999999997e-06 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649215+0000", 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5569999999999997e-06 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61008 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.652987+0000", 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026960600000000001, 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010615097, 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61008 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652987+0000", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652987+0000", 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652986+0000", 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652988+0000", 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0250000000000001e-06 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652994+0000", 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.801e-06 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.652999+0000", 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7600000000000002e-06 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61040 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.657016+0000", 2024-09-21T13:58:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986668, 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066152590000000001, 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61040 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657016+0000", 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657016+0000", 2024-09-21T13:58:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657016+0000", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657019+0000", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4809999999999998e-06 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657026+0000", 2024-09-21T13:58:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8179999999999998e-06 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657031+0000", 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2700000000000004e-06 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59665 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617223+0000", 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038460244999999997, 2024-09-21T13:58:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046462471999999998, 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59665 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617223+0000", 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617223+0000", 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617222+0000", 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617224+0000", 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5289999999999998e-06 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617230+0000", 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5480000000000001e-06 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617235+0000", 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7589999999999997e-06 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59697 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621138+0000", 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034544788, 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042605354999999998, 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59697 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621138+0000", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621138+0000", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621138+0000", 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621139+0000", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.333e-06 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621142+0000", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621145+0000", 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5550000000000001e-06 2024-09-21T13:58:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59734 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.628985+0000", 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026697655000000001, 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034813442, 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59734 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628985+0000", 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628985+0000", 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628985+0000", 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628986+0000", 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.483e-06 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628990+0000", 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.168e-06 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628992+0000", 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6089999999999999e-06 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60977 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649219+0000", 2024-09-21T13:58:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064636210000000001, 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014625414999999999, 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60977 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649219+0000", 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649219+0000", 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649219+0000", 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649221+0000", 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1280000000000002e-06 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649227+0000", 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9089999999999997e-06 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649231+0000", 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5199999999999999e-06 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61009 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653005+0000", 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026782709999999999, 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010872277, 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61009 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653005+0000", 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653005+0000", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653004+0000", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653006+0000", 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3860000000000001e-06 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653012+0000", 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7139999999999998e-06 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653017+0000", 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4519999999999999e-06 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61041 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.657036+0000", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986472, 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068693019999999999, 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61041 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657036+0000", 2024-09-21T13:58:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657036+0000", 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657035+0000", 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657038+0000", 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2730000000000001e-06 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657043+0000", 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7039999999999999e-06 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657048+0000", 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6149999999999999e-06 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59666 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617239+0000", 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038444218000000002, 2024-09-21T13:58:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046715520000000003, 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59666 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617239+0000", 2024-09-21T13:58:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617239+0000", 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617238+0000", 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617240+0000", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.911e-06 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617247+0000", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3969999999999999e-06 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617251+0000", 2024-09-21T13:58:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2830000000000003e-06 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59698 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621147+0000", 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034535733999999998, 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042854638, 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59698 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621147+0000", 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621147+0000", 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621147+0000", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621148+0000", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2270000000000001e-06 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621151+0000", 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621153+0000", 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3970000000000001e-06 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59736 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.628994+0000", 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026688534, 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035066553, 2024-09-21T13:58:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59736 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628994+0000", 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628994+0000", 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628994+0000", 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628995+0000", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.189e-06 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.628998+0000", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9780000000000001e-06 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629001+0000", 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4870000000000001e-06 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60978 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649235+0000", 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064473760000000003, 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.014880259, 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60978 2024-09-21T13:58:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649235+0000", 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649235+0000", 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649235+0000", 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649237+0000", 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1270000000000001e-06 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649243+0000", 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649248+0000", 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61010 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653020+0000", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026625199999999998, 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011149912, 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61010 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653020+0000", 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653020+0000", 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653020+0000", 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653022+0000", 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0040000000000002e-06 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653027+0000", 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3650000000000003e-06 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653032+0000", 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2570000000000001e-06 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61042 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.657052+0000", 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.998631, 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071474650000000004, 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61042 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657052+0000", 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657052+0000", 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657052+0000", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657054+0000", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.199e-06 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657060+0000", 2024-09-21T13:58:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9100000000000002e-06 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657064+0000", 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6099999999999999e-06 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59667 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617255+0000", 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038428139, 2024-09-21T13:58:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046978710999999999, 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59667 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617255+0000", 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617255+0000", 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617254+0000", 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617259+0000", 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.989e-06 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617265+0000", 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6590000000000004e-06 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617270+0000", 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.561e-06 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59699 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621155+0000", 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034527449000000002, 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043106307000000003, 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59699 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621155+0000", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621155+0000", 2024-09-21T13:58:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621155+0000", 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621156+0000", 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1999999999999999e-06 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621159+0000", 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8499999999999998e-06 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621162+0000", 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4739999999999999e-06 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59738 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.629003+0000", 2024-09-21T13:58:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026680100000000002, 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035308652000000003, 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59738 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629003+0000", 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629003+0000", 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629003+0000", 2024-09-21T13:58:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629004+0000", 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.319e-06 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629007+0000", 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8439999999999998e-06 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629011+0000", 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4020000000000004e-06 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60979 3.18 3:1a366bac:::rbd_data.11853c86949e.0000000000000000:a [read 11188224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649252+0000", 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064305250000000003, 2024-09-21T13:58:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015117739, 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60979 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649252+0000", 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649252+0000", 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649252+0000", 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649254+0000", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.249e-06 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649260+0000", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7289999999999997e-06 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649264+0000", 2024-09-21T13:58:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3590000000000001e-06 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.664331+0000", 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015066385 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.664368+0000", 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7382999999999998e-05 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61011 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653035+0000", 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.002647595, 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011408165, 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61011 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653035+0000", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653035+0000", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653035+0000", 2024-09-21T13:58:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653037+0000", 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9659999999999999e-06 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653042+0000", 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4099999999999999e-06 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653047+0000", 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2359999999999998e-06 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61043 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.657069+0000", 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986138, 2024-09-21T13:58:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074141709999999998, 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61043 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657069+0000", 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657069+0000", 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657069+0000", 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657071+0000", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.075e-06 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657076+0000", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5650000000000001e-06 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657081+0000", 2024-09-21T13:58:48.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5909999999999998e-06 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59668 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.617274+0000", 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.038409098000000003, 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047241987999999999, 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59668 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617274+0000", 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617274+0000", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617273+0000", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617275+0000", 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2019999999999998e-06 2024-09-21T13:58:48.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617282+0000", 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.041e-06 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.617287+0000", 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5959999999999997e-06 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59700 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.621164+0000", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.034519239, 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043389588, 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59700 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621164+0000", 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621164+0000", 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621163+0000", 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621165+0000", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.243e-06 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621168+0000", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3060000000000002e-06 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.621170+0000", 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5019999999999999e-06 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:59740 3.2 3.51fd2962 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.629013+0000", 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.026669609, 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.035578735, 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59740 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629013+0000", 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629013+0000", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629013+0000", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629014+0000", 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3400000000000001e-06 2024-09-21T13:58:48.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629018+0000", 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4800000000000001e-06 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.629020+0000", 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5790000000000002e-06 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:60980 3.18 3:1a366bac:::rbd_data.11853c86949e.0000000000000000:a [read 11333632~2048 out=2048b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.649269+0000", 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0064142219999999998, 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015308321, 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 60980 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649269+0000", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649269+0000", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649268+0000", 2024-09-21T13:58:48.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649271+0000", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.368e-06 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649277+0000", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9939999999999997e-06 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.649281+0000", 2024-09-21T13:58:48.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7570000000000004e-06 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.664436+0000", 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015154463 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.664501+0000", 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4770999999999994e-05 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.664577+0000", 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6380999999999999e-05 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61012 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.653051+0000", 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0026321410000000002, 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011677208, 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61012 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653051+0000", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653051+0000", 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653050+0000", 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653053+0000", 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2859999999999998e-06 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653058+0000", 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5679999999999999e-06 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.653063+0000", 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4050000000000002e-06 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:61044 3.18 3.35d66c58 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:47.657085+0000", 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9985981, 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077134880000000001, 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 61044 2024-09-21T13:58:48.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657085+0000", 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657085+0000", 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657084+0000", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657091+0000", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4779999999999996e-06 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657097+0000", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8119999999999996e-06 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:47.657101+0000", 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4599999999999996e-06 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 194 2024-09-21T13:58:48.358 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:48.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:48.361 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:48.359+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:48.460 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:48.459+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:48.509 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:48.509 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:48.509 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:48.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:48.566 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:48.567+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:48.662 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:48.660+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2862382410000004, 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:58:48.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2461514029999998, 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:48.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:48.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:48.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.1848381469999998, 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:48.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:58:48.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43373 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9273344~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1158459010000001, 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057399824000000002, 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43373 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571969+0000", 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571971+0000", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.875e-06 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571977+0000", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6869999999999999e-06 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571981+0000", 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3780000000000003e-06 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624831+0000", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052849396 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624906+0000", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5488999999999995e-05 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.629369+0000", 2024-09-21T13:58:48.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044633140000000003 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43403 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9031680~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577388+0000", 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1104278519999999, 2024-09-21T13:58:48.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054285935, 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43403 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577388+0000", 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577388+0000", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577387+0000", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577389+0000", 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.029e-06 2024-09-21T13:58:48.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577395+0000", 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1079999999999998e-06 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577411+0000", 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614999999999999e-05 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631533+0000", 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054121928999999999 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631598+0000", 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5072000000000003e-05 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631674+0000", 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5525999999999995e-05 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.711 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43404 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 8984576~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577416+0000", 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1103996490000001, 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054421920999999998, 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43404 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577416+0000", 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577416+0000", 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577415+0000", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577418+0000", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5849999999999998e-06 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577424+0000", 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0759999999999999e-06 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577429+0000", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7330000000000003e-06 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631695+0000", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054266079000000002 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631762+0000", 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6753000000000003e-05 2024-09-21T13:58:48.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631838+0000", 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6093999999999993e-05 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43405 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9048064~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577443+0000", 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1103728450000001, 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054538627999999999, 2024-09-21T13:58:48.716 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43405 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577443+0000", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577443+0000", 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577442+0000", 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577445+0000", 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577452+0000", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577457+0000", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5220000000000001e-06 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631859+0000", 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054402245000000002 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631923+0000", 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4299000000000002e-05 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.631981+0000", 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8072999999999998e-05 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43406 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9000960~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.720 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577461+0000", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1103547059999999, 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055141347, 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43406 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577461+0000", 2024-09-21T13:58:48.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577461+0000", 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577460+0000", 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577462+0000", 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.03e-06 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577468+0000", 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6300000000000003e-06 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577473+0000", 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4150000000000001e-06 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632003+0000", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054530035999999997 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632069+0000", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6389000000000004e-05 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632602+0000", 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00053318899999999999 2024-09-21T13:58:48.724 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43407 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9064448~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577485+0000", 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1103306630000001, 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055303098000000002, 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43407 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577485+0000", 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577485+0000", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577484+0000", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577487+0000", 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.367e-06 2024-09-21T13:58:48.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577493+0000", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9139999999999996e-06 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577497+0000", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6360000000000002e-06 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632627+0000", 2024-09-21T13:58:48.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055129598000000002 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632695+0000", 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8423999999999994e-05 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632788+0000", 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2540999999999994e-05 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43408 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9017344~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.577546+0000", 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1102699989999998, 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055417174, 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43408 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577546+0000", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577546+0000", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577501+0000", 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999557 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577552+0000", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0667999999999997e-05 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577559+0000", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7880000000000001e-06 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.577563+0000", 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7740000000000004e-06 2024-09-21T13:58:48.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632812+0000", 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055248790999999998 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632875+0000", 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3125000000000003e-05 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.632963+0000", 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7415000000000002e-05 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43422 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9132032~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581133+0000", 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1066827080000001, 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054391736000000003, 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.734 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43422 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581133+0000", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581133+0000", 2024-09-21T13:58:48.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581132+0000", 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581135+0000", 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.232e-06 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581140+0000", 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2599999999999996e-06 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581144+0000", 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4290000000000003e-06 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635376+0000", 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054231345 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635442+0000", 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6105000000000005e-05 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635525+0000", 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2744000000000006e-05 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43423 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9195520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581150+0000", 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1066654370000002, 2024-09-21T13:58:48.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054550390999999997, 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43423 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581150+0000", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581150+0000", 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581150+0000", 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581152+0000", 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1090000000000001e-06 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581157+0000", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3569999999999997e-06 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581162+0000", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.386e-06 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635551+0000", 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054389066999999999 2024-09-21T13:58:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635617+0000", 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6647000000000001e-05 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635700+0000", 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3182000000000004e-05 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43424 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9148416~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581165+0000", 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.106650084, 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054712138, 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43424 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581165+0000", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581165+0000", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581165+0000", 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581167+0000", 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.978e-06 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581173+0000", 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5010000000000004e-06 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581177+0000", 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2339999999999996e-06 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635727+0000", 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054549833999999998 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635793+0000", 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6066000000000001e-05 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635878+0000", 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4887000000000002e-05 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43425 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9211904~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581181+0000", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1066346519999999, 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054872756000000002, 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43425 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581181+0000", 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581181+0000", 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581180+0000", 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581183+0000", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0209999999999998e-06 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581190+0000", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1080000000000004e-06 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581194+0000", 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4510000000000002e-06 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635903+0000", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054709254999999998 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.635970+0000", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6364000000000004e-05 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636054+0000", 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3908999999999999e-05 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43426 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9164800~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581198+0000", 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1066173419999998, 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055030313999999997, 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43426 2024-09-21T13:58:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581198+0000", 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581198+0000", 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581198+0000", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581200+0000", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9010000000000001e-06 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581205+0000", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5609999999999998e-06 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581212+0000", 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8000000000000001e-06 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636079+0000", 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054867267999999997 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636147+0000", 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7478999999999995e-05 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636228+0000", 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1638999999999995e-05 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43427 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9228288~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581216+0000", 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1065995640000001, 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055187975, 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43427 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581216+0000", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581216+0000", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581216+0000", 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581218+0000", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9690000000000001e-06 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581223+0000", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4820000000000002e-06 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581229+0000", 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6710000000000004e-06 2024-09-21T13:58:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636255+0000", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055025878 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636321+0000", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6087999999999995e-05 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636404+0000", 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3250000000000004e-05 2024-09-21T13:58:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43428 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9181184~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581233+0000", 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1065829460000001, 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055346053999999999, 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43428 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581233+0000", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581233+0000", 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581232+0000", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581234+0000", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.916e-06 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581240+0000", 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T13:58:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581245+0000", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9130000000000002e-06 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636430+0000", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055185572000000002 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636496+0000", 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6203000000000003e-05 2024-09-21T13:58:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636579+0000", 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2237000000000006e-05 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43429 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9244672~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.581249+0000", 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1065669460000001, 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055504639000000001, 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43429 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581249+0000", 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581249+0000", 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581248+0000", 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581250+0000", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9599999999999999e-06 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581256+0000", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1959999999999996e-06 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.581261+0000", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2899999999999996e-06 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636604+0000", 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055343284 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636671+0000", 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6678000000000001e-05 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.636753+0000", 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2588000000000003e-05 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43437 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9310208~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.585107+0000", 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1027088360000001, 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054531896000000003, 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43437 2024-09-21T13:58:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585107+0000", 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585107+0000", 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585106+0000", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585108+0000", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585114+0000", 2024-09-21T13:58:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6570000000000002e-06 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585118+0000", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2760000000000002e-06 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639459+0000", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054340337000000002 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639540+0000", 2024-09-21T13:58:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1291000000000005e-05 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639639+0000", 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8615000000000004e-05 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43438 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9263104~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.585122+0000", 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.1026931260000001, 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054732716000000001, 2024-09-21T13:58:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43438 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585122+0000", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585122+0000", 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585122+0000", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585124+0000", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0770000000000002e-06 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585130+0000", 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4620000000000004e-06 2024-09-21T13:58:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.585134+0000", 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2119999999999997e-06 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639681+0000", 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.054547467000000002 2024-09-21T13:58:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639757+0000", 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5424000000000002e-05 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.639855+0000", 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8424000000000005e-05 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:48.780 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:48.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:48.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:48.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:48.779+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:48.882 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:48.883+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:48.914 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:48.914 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:48.914 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:48.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:48.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:48.983+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:48.998 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:48.998 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:49.017 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:49.017 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:49.032 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:49.032 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:49.047 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:49.048 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:49.066 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:49.067 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:49.086 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:49.087+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:49.087 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:49.088 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:49.094 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.094 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.103 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:49.103 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:49.104 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:58:49.106 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:58:49.107 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:58:49.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:49.187 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:49.187+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:49.224 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.225 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.238 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:49.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:49.287+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:49.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.377 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.384 INFO:teuthology.orchestra.run.smithi079.stdout:1473 write 0x53fbb4e thru 0x540b770 (0xfc23 bytes) 2024-09-21T13:58:49.389 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:49.388+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:49.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:49.410 INFO:teuthology.orchestra.run.smithi079.stdout:1474 write 0xd98ca63 thru 0xd996842 (0x9de0 bytes) 2024-09-21T13:58:49.414 INFO:teuthology.orchestra.run.smithi079.stdout:1475 writesame 0x57cb314 thru 0x57d3cb1 data_size 0x41(0x899e bytes) 2024-09-21T13:58:49.417 INFO:teuthology.orchestra.run.smithi079.stdout:1476 read 0x2448a38 thru 0x2453d7e (0xb347 bytes) 2024-09-21T13:58:49.428 INFO:teuthology.orchestra.run.smithi079.stdout:1477 writesame 0xe498b78 thru 0xe4a2ba0 data_size 0x4f(0xa029 bytes) 2024-09-21T13:58:49.428 INFO:teuthology.orchestra.run.smithi079.stdout:1478 clone 9 order 18 su 32768 sc 2 2024-09-21T13:58:49.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:58:49.498 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:49.499+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:49.557 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.557 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:49.617 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:49.616+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:49.692 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:49.691+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:49.695 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.695 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.710 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:49.793 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:49.791+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:49.878 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:49.878 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:49.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:49.894 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:49.892+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:49.995 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:49.992+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:50.008 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.008 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:50.109 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:50.108+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:50.188 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.189 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:50.195+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:50.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:50.298 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:50.296+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:50.314 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.314 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:50.343 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:58:50.400 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:50.396+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:50.458 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.458 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:50.482 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone8 from 0xe4a2ba1 (overlap 0x65f7fc5) to 0x1e97321 2024-09-21T13:58:50.500 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:50.499+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:50.590 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.590 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:50.599+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:50.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:50.689 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-21T13:58:50.701 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:50.699+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:50.797 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:50.797 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:50.802 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:50.799+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:50.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:50.903 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:50.899+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:51.004 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:51.003+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:51.024 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:51.025 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:51.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:51.104 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:51.099+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:51.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:51.205 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:51.202+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:51.247 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:51.247 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:51.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:51.306 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:51.303+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:51.337 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:51.337 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:51.369 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:51.370 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:51.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:51.392 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:51.407 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:51.406+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:51.417 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:51.418 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:51.445 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:51.445 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:51.473 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:51.473 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:51.490 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:51.490 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:51.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:87446 3.0 3:05b35069:::rbd_data.11853c86949e.0000000000000007:a [read 10420224~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:51.485299+0000", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0073494600000000004, 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073789169999999996, 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 87446 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485299+0000", 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485299+0000", 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485299+0000", 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485301+0000", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3470000000000001e-06 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485308+0000", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1589999999999998e-06 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485313+0000", 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0030000000000002e-06 2024-09-21T13:58:51.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.492638+0000", 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073251410000000003 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:87448 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:51.485317+0000", 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0073321369999999999, 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074343789999999996, 2024-09-21T13:58:51.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 87448 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485317+0000", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485317+0000", 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485316+0000", 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485319+0000", 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485324+0000", 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.772e-06 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485329+0000", 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7169999999999999e-06 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:87450 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:51.485333+0000", 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0073157609999999996, 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0074882860000000002, 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 87450 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485333+0000", 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485333+0000", 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485333+0000", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485335+0000", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0600000000000002e-06 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485341+0000", 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:58:51.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485346+0000", 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:87452 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:51.485656+0000", 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0069932049999999997, 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072221550000000001, 2024-09-21T13:58:51.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 87452 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485656+0000", 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485656+0000", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485655+0000", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485660+0000", 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7910000000000004e-06 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485670+0000", 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0098000000000001e-05 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:51.485677+0000", 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0829999999999998e-06 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.504 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 4 2024-09-21T13:58:51.505 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:51.505 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:51.505 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:58:51.507 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:58:51.508 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:58:51.508 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:51.506+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:51.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:51.609 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:51.603+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:51.709 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:51.707+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:51.724 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:51.725 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:51.725 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:51.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:51.810 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:51.807+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:51.900 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:51.900 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:51.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3799702739999997, 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.901 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:51.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.905 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3798586509999993, 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:51.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:58:51.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3798388280000005, 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:58:51.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:58:51.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3798146490000001, 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:58:51.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:58:51.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:58:51.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3797905440000005, 2024-09-21T13:58:51.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:58:51.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:58:51.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3797720350000002, 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:58:51.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3797622930000006, 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:51.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3797374340000008, 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:58:51.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3797087569999995, 2024-09-21T13:58:51.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:58:51.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:58:51.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3796899390000004, 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:58:51.947 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3796692680000007, 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:58:51.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3796481969999999, 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:51.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:58:51.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:58:51.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:51.957 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.379612345, 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:58:51.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3795801230000002, 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:58:51.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:58:51.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3795444830000001, 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:51.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:58:51.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3795100050000002, 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:58:51.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:58:51.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3794554449999996, 2024-09-21T13:58:51.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:58:51.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3794162799999992, 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:51.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:58:51.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3793775440000005, 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.987 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:58:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3793527910000005, 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:58:51.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:58:51.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:51.996 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:51.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:51.998 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:51.994+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:52.098 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:52.098+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:52.199 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:52.198+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:52.206 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:52.206 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:52.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95821 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.193905+0000", 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0056797999999999996, 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057030980000000002, 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95821 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193905+0000", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193905+0000", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193905+0000", 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193907+0000", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3689999999999999e-06 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193910+0000", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.96e-06 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193913+0000", 2024-09-21T13:58:52.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1760000000000002e-06 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95878 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197730+0000", 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0018550820000000001, 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001940752, 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95878 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197730+0000", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197730+0000", 2024-09-21T13:58:52.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197730+0000", 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197732+0000", 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.565e-06 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197739+0000", 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4670000000000001e-06 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197744+0000", 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8160000000000001e-06 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96227 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198576+0000", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001008826, 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011463739999999999, 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96227 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198576+0000", 2024-09-21T13:58:52.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198576+0000", 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198576+0000", 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198578+0000", 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198584+0000", 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6409999999999999e-06 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198589+0000", 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96261 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199445+0000", 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00014079000000000001, 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032786000000000002, 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96261 2024-09-21T13:58:52.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199445+0000", 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199445+0000", 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199444+0000", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199447+0000", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.537e-06 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199454+0000", 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1420000000000004e-06 2024-09-21T13:58:52.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199459+0000", 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1379999999999998e-06 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96640 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.192533+0000", 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0070518890000000004, 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072931849999999998, 2024-09-21T13:58:52.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96640 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192533+0000", 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192533+0000", 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192533+0000", 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192534+0000", 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2130000000000001e-06 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192537+0000", 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.931e-06 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.192540+0000", 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5450000000000002e-06 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95822 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.193933+0000", 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0056526780000000004, 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059436740000000004, 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95822 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193933+0000", 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193933+0000", 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193932+0000", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193934+0000", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.516e-06 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193941+0000", 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3479999999999998e-06 2024-09-21T13:58:52.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193945+0000", 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95880 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197749+0000", 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001836512, 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002173042, 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.227 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95880 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197749+0000", 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197749+0000", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197748+0000", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197751+0000", 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3539999999999998e-06 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197757+0000", 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7019999999999998e-06 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197761+0000", 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8969999999999999e-06 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.230 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96228 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198604+0000", 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00098176600000000002, 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00136411, 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96228 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198604+0000", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198604+0000", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198603+0000", 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198606+0000", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198612+0000", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1670000000000004e-06 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198617+0000", 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.062e-06 2024-09-21T13:58:52.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96262 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199480+0000", 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00010559400000000001, 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054157399999999996, 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96262 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199480+0000", 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199480+0000", 2024-09-21T13:58:52.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199479+0000", 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199482+0000", 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.667e-06 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199488+0000", 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4219999999999997e-06 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199493+0000", 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9989999999999999e-06 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95823 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.193948+0000", 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0056369539999999996, 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061220240000000002, 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95823 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193948+0000", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193948+0000", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193948+0000", 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193950+0000", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.401e-06 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193952+0000", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679999999999998e-06 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193955+0000", 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5890000000000001e-06 2024-09-21T13:58:52.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95882 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197777+0000", 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001808498, 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023410309999999999, 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95882 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197777+0000", 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197777+0000", 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197776+0000", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197779+0000", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197785+0000", 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4280000000000001e-06 2024-09-21T13:58:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197790+0000", 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7670000000000003e-06 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96230 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198634+0000", 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00095136699999999995, 2024-09-21T13:58:52.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001511887, 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96230 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198634+0000", 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198634+0000", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198633+0000", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198636+0000", 2024-09-21T13:58:52.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3800000000000001e-06 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198642+0000", 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.178e-06 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198647+0000", 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7609999999999998e-06 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.247 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96263 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199497+0000", 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7857999999999998e-05, 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067627200000000001, 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96263 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199497+0000", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199497+0000", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199497+0000", 2024-09-21T13:58:52.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199499+0000", 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3379999999999999e-06 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199505+0000", 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8000000000000004e-06 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199510+0000", 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5009999999999998e-06 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95824 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.193973+0000", 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.005611876, 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062347740000000002, 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95824 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193973+0000", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193973+0000", 2024-09-21T13:58:52.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193973+0000", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193975+0000", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4950000000000001e-06 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193981+0000", 2024-09-21T13:58:52.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7880000000000001e-06 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193984+0000", 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0019999999999998e-06 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95884 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197795+0000", 2024-09-21T13:58:52.254 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0017902129999999999, 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024708899999999999, 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95884 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197795+0000", 2024-09-21T13:58:52.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197795+0000", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197795+0000", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197797+0000", 2024-09-21T13:58:52.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3269999999999999e-06 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197803+0000", 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7250000000000002e-06 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197808+0000", 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.079e-06 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96231 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198660+0000", 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00092549799999999997, 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001661179, 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96231 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.258 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198660+0000", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198660+0000", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198659+0000", 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198662+0000", 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6579999999999998e-06 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198668+0000", 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0519999999999998e-06 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198673+0000", 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0080000000000002e-06 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96264 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199528+0000", 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7729999999999998e-05, 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00084814000000000005, 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96264 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199528+0000", 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199528+0000", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199527+0000", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199530+0000", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6599999999999999e-06 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199536+0000", 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199541+0000", 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8509999999999998e-06 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95825 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.193987+0000", 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0055987650000000003, 2024-09-21T13:58:52.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064243729999999997, 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95825 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193987+0000", 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193987+0000", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193986+0000", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193988+0000", 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.269e-06 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193991+0000", 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.193993+0000", 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.267 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95886 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197814+0000", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0017712559999999999, 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026286199999999999, 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95886 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197814+0000", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197814+0000", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197814+0000", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197816+0000", 2024-09-21T13:58:52.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3800000000000001e-06 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197822+0000", 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9329999999999998e-06 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197827+0000", 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96232 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198706+0000", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00087961500000000004, 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017768059999999999, 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96232 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198706+0000", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198706+0000", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198705+0000", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198711+0000", 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999999e-06 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198717+0000", 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5259999999999999e-06 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198723+0000", 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2070000000000003e-06 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96265 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199554+0000", 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.1037000000000001e-05, 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0009851599999999999, 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96265 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199554+0000", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199554+0000", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199554+0000", 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199556+0000", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4269999999999998e-06 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199563+0000", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.46e-06 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199568+0000", 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1490000000000002e-06 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.276 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95826 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194014+0000", 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0055717869999999999, 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065826260000000003, 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95826 2024-09-21T13:58:52.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194014+0000", 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194014+0000", 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194013+0000", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194015+0000", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.567e-06 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194021+0000", 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6619999999999999e-06 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194024+0000", 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.931e-06 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95888 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197839+0000", 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0017462230000000001, 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028120810000000001, 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95888 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197839+0000", 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197839+0000", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197839+0000", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197841+0000", 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8490000000000002e-06 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197848+0000", 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7599999999999997e-06 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197853+0000", 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8579999999999999e-06 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.283 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96233 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198727+0000", 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00085818899999999998, 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019626399999999999, 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96233 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198727+0000", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198727+0000", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198727+0000", 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198729+0000", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198735+0000", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5949999999999998e-06 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198739+0000", 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4120000000000003e-06 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.286 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96266 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199597+0000", 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9999881, 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00112043, 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96266 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.287 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199597+0000", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199597+0000", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199597+0000", 2024-09-21T13:58:52.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199599+0000", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7259999999999998e-06 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199606+0000", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4289999999999998e-06 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199611+0000", 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.045e-06 2024-09-21T13:58:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95827 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194027+0000", 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0055587900000000001, 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006736873, 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95827 2024-09-21T13:58:52.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194027+0000", 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194027+0000", 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194026+0000", 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194028+0000", 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.207e-06 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194030+0000", 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9639999999999999e-06 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194033+0000", 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.295e-06 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95889 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197866+0000", 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001719309, 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00295831, 2024-09-21T13:58:52.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95889 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197866+0000", 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197866+0000", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197865+0000", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197868+0000", 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197874+0000", 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9449999999999998e-06 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197880+0000", 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.665e-06 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.296 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96234 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198744+0000", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00084176900000000002, 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002136382, 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96234 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198744+0000", 2024-09-21T13:58:52.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198744+0000", 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198743+0000", 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198745+0000", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.249e-06 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198751+0000", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.451e-06 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198756+0000", 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7779999999999998e-06 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96267 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199615+0000", 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.99997, 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013141069999999999, 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96267 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.300 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199615+0000", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199615+0000", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199615+0000", 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199617+0000", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4949999999999998e-06 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199623+0000", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8379999999999998e-06 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199628+0000", 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.639e-06 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95828 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194051+0000", 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0055339330000000004, 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0069072910000000003, 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95828 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194051+0000", 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194051+0000", 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194051+0000", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194062+0000", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0584999999999999e-05 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194065+0000", 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8750000000000002e-06 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194068+0000", 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.016e-06 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95891 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197884+0000", 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0017012850000000001, 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031033900000000001, 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.306 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95891 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197884+0000", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197884+0000", 2024-09-21T13:58:52.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197884+0000", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197886+0000", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1320000000000001e-06 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197892+0000", 2024-09-21T13:58:52.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7960000000000001e-06 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197896+0000", 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.549e-06 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96235 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198783+0000", 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00080274899999999995, 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022459609999999999, 2024-09-21T13:58:52.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96235 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198783+0000", 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198783+0000", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198782+0000", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198785+0000", 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5390000000000002e-06 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198791+0000", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3419999999999996e-06 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198796+0000", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5879999999999997e-06 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96268 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199642+0000", 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9999428, 2024-09-21T13:58:52.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014419159999999999, 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96268 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199642+0000", 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199642+0000", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199642+0000", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199645+0000", 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199651+0000", 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1840000000000004e-06 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199656+0000", 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8849999999999998e-06 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.315 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95829 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194090+0000", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.005495588, 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070523740000000001, 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95829 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194090+0000", 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194090+0000", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194089+0000", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194091+0000", 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5650000000000001e-06 2024-09-21T13:58:52.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194098+0000", 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.878e-06 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194100+0000", 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5840000000000002e-06 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95892 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197925+0000", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0016607379999999999, 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032694859999999998, 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95892 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197925+0000", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197925+0000", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197924+0000", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197927+0000", 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.582e-06 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197934+0000", 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3100000000000003e-06 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197939+0000", 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1549999999999998e-06 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96236 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198819+0000", 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00076673699999999997, 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002409923, 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96236 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.322 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198819+0000", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198819+0000", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198818+0000", 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198821+0000", 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8260000000000001e-06 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198827+0000", 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0589999999999999e-06 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198832+0000", 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8879999999999996e-06 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96269 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199676+0000", 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9999099, 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015808339999999999, 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96269 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199676+0000", 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199676+0000", 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199675+0000", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199680+0000", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3689999999999998e-06 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199687+0000", 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.19e-06 2024-09-21T13:58:52.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199692+0000", 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2170000000000002e-06 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95830 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194103+0000", 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0054826939999999998, 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072002519999999999, 2024-09-21T13:58:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95830 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194103+0000", 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194103+0000", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194102+0000", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194104+0000", 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2190000000000001e-06 2024-09-21T13:58:52.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194107+0000", 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0850000000000001e-06 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194109+0000", 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.317e-06 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95893 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197959+0000", 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0016258080000000001, 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003398383, 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95893 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197959+0000", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197959+0000", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197959+0000", 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197962+0000", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197968+0000", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3709999999999996e-06 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197973+0000", 2024-09-21T13:58:52.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7439999999999998e-06 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96238 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198844+0000", 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00074172599999999995, 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025693980000000001, 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96238 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198844+0000", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198844+0000", 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198843+0000", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198846+0000", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.441e-06 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198852+0000", 2024-09-21T13:58:52.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1979999999999998e-06 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198857+0000", 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5509999999999999e-06 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96270 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199697+0000", 2024-09-21T13:58:52.338 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9998889, 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017655699999999999, 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96270 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199697+0000", 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199697+0000", 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199696+0000", 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199698+0000", 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.413e-06 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199704+0000", 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6500000000000001e-06 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199709+0000", 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3769999999999998e-06 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95831 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194129+0000", 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0054565389999999998, 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073624839999999999, 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95831 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.342 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194129+0000", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194129+0000", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194128+0000", 2024-09-21T13:58:52.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194130+0000", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.407e-06 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194137+0000", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194140+0000", 2024-09-21T13:58:52.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95894 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197985+0000", 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001600193, 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035338850000000001, 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95894 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197985+0000", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197985+0000", 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197985+0000", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197987+0000", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.666e-06 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197993+0000", 2024-09-21T13:58:52.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1319999999999999e-06 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197998+0000", 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0069999999999997e-06 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96239 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198869+0000", 2024-09-21T13:58:52.348 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00071651899999999999, 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002696628, 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96239 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198869+0000", 2024-09-21T13:58:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198869+0000", 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198868+0000", 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198871+0000", 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3939999999999999e-06 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198879+0000", 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6370000000000005e-06 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198884+0000", 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9989999999999999e-06 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96271 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199713+0000", 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9998717, 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019081079999999999, 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96271 2024-09-21T13:58:52.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199713+0000", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199713+0000", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199713+0000", 2024-09-21T13:58:52.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199715+0000", 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.294e-06 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199721+0000", 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0000000000000002e-06 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199726+0000", 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6179999999999997e-06 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95832 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194142+0000", 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0054434779999999999, 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0075372240000000004, 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95832 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194142+0000", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194142+0000", 2024-09-21T13:58:52.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194142+0000", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194143+0000", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.226e-06 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194146+0000", 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0369999999999999e-06 2024-09-21T13:58:52.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194148+0000", 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4729999999999999e-06 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95896 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198017+0000", 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0015684970000000001, 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003708247, 2024-09-21T13:58:52.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95896 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198017+0000", 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198017+0000", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198016+0000", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198022+0000", 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3730000000000001e-06 2024-09-21T13:58:52.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198028+0000", 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5039999999999999e-06 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198033+0000", 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1070000000000004e-06 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96240 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198889+0000", 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00069654000000000005, 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028641669999999999, 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96240 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198889+0000", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198889+0000", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198888+0000", 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198891+0000", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.311e-06 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198896+0000", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8540000000000002e-06 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198901+0000", 2024-09-21T13:58:52.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5170000000000001e-06 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96272 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199730+0000", 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9998555, 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020508480000000001, 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96272 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199730+0000", 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199730+0000", 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199730+0000", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199732+0000", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199737+0000", 2024-09-21T13:58:52.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3669999999999996e-06 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199742+0000", 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5519999999999998e-06 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95833 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194168+0000", 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0054173520000000003, 2024-09-21T13:58:52.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076482989999999999, 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95833 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194168+0000", 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194168+0000", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194168+0000", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194169+0000", 2024-09-21T13:58:52.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.719e-06 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194176+0000", 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7789999999999998e-06 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194179+0000", 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9519999999999999e-06 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95898 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198038+0000", 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001547517, 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038329940000000002, 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95898 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198038+0000", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198038+0000", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198037+0000", 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198040+0000", 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2539999999999999e-06 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198045+0000", 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8429999999999998e-06 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198050+0000", 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6e-06 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96241 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198905+0000", 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00067990599999999998, 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030213750000000002, 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96241 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198905+0000", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198905+0000", 2024-09-21T13:58:52.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198905+0000", 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198907+0000", 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.328e-06 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198913+0000", 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5310000000000001e-06 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198917+0000", 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4830000000000001e-06 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96273 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199759+0000", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9998264, 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002224279, 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96273 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199759+0000", 2024-09-21T13:58:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199759+0000", 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199758+0000", 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199761+0000", 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7250000000000002e-06 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199768+0000", 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5440000000000001e-06 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199773+0000", 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0150000000000003e-06 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95834 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194181+0000", 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0054039939999999996, 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078371229999999997, 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95834 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.382 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194181+0000", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194181+0000", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194181+0000", 2024-09-21T13:58:52.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194182+0000", 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2109999999999999e-06 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194185+0000", 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9380000000000001e-06 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194188+0000", 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559999999999999e-06 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95900 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198086+0000", 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0014993350000000001, 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039599630000000004, 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95900 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198086+0000", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198086+0000", 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198085+0000", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198088+0000", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7609999999999999e-06 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198095+0000", 2024-09-21T13:58:52.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4590000000000003e-06 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198100+0000", 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7819999999999999e-06 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96242 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198921+0000", 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00066430700000000005, 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031540729999999999, 2024-09-21T13:58:52.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96242 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198921+0000", 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198921+0000", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198921+0000", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198923+0000", 2024-09-21T13:58:52.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0700000000000001e-06 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198928+0000", 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7289999999999997e-06 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198933+0000", 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3769999999999998e-06 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96275 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199778+0000", 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9998074, 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002347834, 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96275 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.392 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199778+0000", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199778+0000", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199777+0000", 2024-09-21T13:58:52.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199780+0000", 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5409999999999999e-06 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199786+0000", 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199790+0000", 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6290000000000001e-06 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95835 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194208+0000", 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0053776579999999996, 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007975088, 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95835 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194208+0000", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194208+0000", 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194207+0000", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194209+0000", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3999999999999999e-06 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194212+0000", 2024-09-21T13:58:52.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0869999999999998e-06 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194214+0000", 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6639999999999998e-06 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95912 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198124+0000", 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001461356, 2024-09-21T13:58:52.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041138570000000003, 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95912 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198124+0000", 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198124+0000", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198123+0000", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198126+0000", 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-21T13:58:52.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198133+0000", 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4239999999999998e-06 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198139+0000", 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9349999999999999e-06 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96243 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198965+0000", 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.000619931, 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003315134, 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96243 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198965+0000", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198965+0000", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198965+0000", 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198968+0000", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7460000000000001e-06 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198974+0000", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6780000000000003e-06 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198979+0000", 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7129999999999996e-06 2024-09-21T13:58:52.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96279 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199806+0000", 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9997792, 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025028540000000001, 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96279 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199806+0000", 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199806+0000", 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199805+0000", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199808+0000", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5459999999999998e-06 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199814+0000", 2024-09-21T13:58:52.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.156e-06 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199819+0000", 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9799999999999998e-06 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95836 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194237+0000", 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0053482959999999998, 2024-09-21T13:58:52.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081001830000000004, 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95836 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194237+0000", 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194237+0000", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194237+0000", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194238+0000", 2024-09-21T13:58:52.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3349999999999999e-06 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194246+0000", 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8990000000000001e-06 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194249+0000", 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95914 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198149+0000", 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0014359640000000001, 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042355700000000001, 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95914 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.412 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198149+0000", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198149+0000", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198149+0000", 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198151+0000", 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.497e-06 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198157+0000", 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3410000000000002e-06 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198163+0000", 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0170000000000002e-06 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96244 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199002+0000", 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00058314900000000004, 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003438357, 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96244 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199002+0000", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199002+0000", 2024-09-21T13:58:52.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199002+0000", 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199004+0000", 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6579999999999998e-06 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199012+0000", 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6599999999999995e-06 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199017+0000", 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3279999999999996e-06 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96281 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.418 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199838+0000", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9997468, 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026576939999999999, 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96281 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199838+0000", 2024-09-21T13:58:52.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199838+0000", 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199838+0000", 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199841+0000", 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6010000000000002e-06 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199848+0000", 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2180000000000002e-06 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199853+0000", 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9749999999999998e-06 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95837 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194251+0000", 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0053338919999999998, 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082940919999999994, 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95837 2024-09-21T13:58:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194251+0000", 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194251+0000", 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194251+0000", 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194252+0000", 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194255+0000", 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9830000000000001e-06 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194258+0000", 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4849999999999999e-06 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95915 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198166+0000", 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001418889, 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044072110000000003, 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.425 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95915 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198166+0000", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198166+0000", 2024-09-21T13:58:52.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198166+0000", 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198168+0000", 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8780000000000001e-06 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198173+0000", 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9119999999999997e-06 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198177+0000", 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.019e-06 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96245 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199045+0000", 2024-09-21T13:58:52.428 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00054065099999999996, 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035577289999999999, 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96245 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199045+0000", 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199045+0000", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199044+0000", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199050+0000", 2024-09-21T13:58:52.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.383e-06 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199056+0000", 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7630000000000003e-06 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199061+0000", 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0379999999999999e-06 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96283 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199864+0000", 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9997215, 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027886719999999999, 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96283 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199864+0000", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199864+0000", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199863+0000", 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199866+0000", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.43e-06 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199872+0000", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1530000000000002e-06 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199877+0000", 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8949999999999997e-06 2024-09-21T13:58:52.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95838 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194279+0000", 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.005306659, 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084311339999999999, 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95838 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194279+0000", 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194279+0000", 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194278+0000", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194280+0000", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.28e-06 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194287+0000", 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8029999999999997e-06 2024-09-21T13:58:52.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194290+0000", 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.649e-06 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95918 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198195+0000", 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001390063, 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046271000000000003, 2024-09-21T13:58:52.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95918 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198195+0000", 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198195+0000", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198195+0000", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198197+0000", 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5440000000000001e-06 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198203+0000", 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9359999999999996e-06 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198207+0000", 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.25e-06 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.441 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96246 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199066+0000", 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00051945300000000002, 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037851450000000002, 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96246 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199066+0000", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199066+0000", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199065+0000", 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199068+0000", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3e-06 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199073+0000", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6489999999999996e-06 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199078+0000", 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6290000000000001e-06 2024-09-21T13:58:52.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96284 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199896+0000", 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9996891, 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029943109999999999, 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96284 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199896+0000", 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199896+0000", 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199896+0000", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199898+0000", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.441e-06 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199904+0000", 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8619999999999999e-06 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199909+0000", 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7149999999999997e-06 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95839 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194292+0000", 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.005292883, 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086542679999999997, 2024-09-21T13:58:52.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95839 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194292+0000", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194292+0000", 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194292+0000", 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194293+0000", 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2470000000000001e-06 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194296+0000", 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0450000000000001e-06 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194299+0000", 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4949999999999998e-06 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95920 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198222+0000", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0013637429999999999, 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047835159999999998, 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95920 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198222+0000", 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198222+0000", 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198221+0000", 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198224+0000", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7219999999999999e-06 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198230+0000", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1859999999999997e-06 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198235+0000", 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6990000000000002e-06 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96247 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199091+0000", 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00049427200000000003, 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039693310000000004, 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96247 2024-09-21T13:58:52.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199091+0000", 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199091+0000", 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199090+0000", 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199093+0000", 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.486e-06 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199099+0000", 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1929999999999998e-06 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199104+0000", 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.045e-06 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96286 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199921+0000", 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9996643, 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031712569999999998, 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.458 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96286 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199921+0000", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199921+0000", 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199920+0000", 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199923+0000", 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199930+0000", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1189999999999999e-06 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199935+0000", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9180000000000002e-06 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95840 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194321+0000", 2024-09-21T13:58:52.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0052642119999999999, 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088026709999999998, 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95840 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194321+0000", 2024-09-21T13:58:52.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194321+0000", 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194321+0000", 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194324+0000", 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2930000000000001e-06 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194327+0000", 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.202e-06 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194330+0000", 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6350000000000002e-06 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95922 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198239+0000", 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0013464550000000001, 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049301919999999999, 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95922 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198239+0000", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198239+0000", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198238+0000", 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198241+0000", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.295e-06 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198246+0000", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4639999999999997e-06 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198251+0000", 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4530000000000004e-06 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96248 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199108+0000", 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00047688199999999998, 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041159059999999999, 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.468 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96248 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199108+0000", 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199108+0000", 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199108+0000", 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199110+0000", 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4030000000000001e-06 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199116+0000", 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1419999999999998e-06 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199121+0000", 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5430000000000004e-06 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96288 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199954+0000", 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9996309, 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033291459999999998, 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96288 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199954+0000", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199954+0000", 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199953+0000", 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199956+0000", 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.678e-06 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199962+0000", 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.105e-06 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199967+0000", 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8670000000000002e-06 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95841 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.474 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194332+0000", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0052533390000000001, 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090019839999999993, 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95841 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194332+0000", 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194332+0000", 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194332+0000", 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194333+0000", 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1489999999999999e-06 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194336+0000", 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9129999999999999e-06 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194338+0000", 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5560000000000002e-06 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95925 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198256+0000", 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00132923, 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051061320000000002, 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95925 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198256+0000", 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198256+0000", 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198256+0000", 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198258+0000", 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3420000000000002e-06 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198263+0000", 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2020000000000003e-06 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198268+0000", 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.797e-06 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96249 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199132+0000", 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00045327399999999998, 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042607809999999999, 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96249 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199132+0000", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199132+0000", 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199131+0000", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199134+0000", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5050000000000002e-06 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199140+0000", 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7939999999999999e-06 2024-09-21T13:58:52.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199145+0000", 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6930000000000004e-06 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96290 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199978+0000", 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9996071, 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003461768, 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96290 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199978+0000", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199978+0000", 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199978+0000", 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199983+0000", 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2000000000000002e-06 2024-09-21T13:58:52.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199989+0000", 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2859999999999996e-06 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199994+0000", 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0549999999999999e-06 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95842 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194360+0000", 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0052255169999999998, 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091396789999999995, 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95842 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194360+0000", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194360+0000", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194359+0000", 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194361+0000", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4789999999999999e-06 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194368+0000", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194371+0000", 2024-09-21T13:58:52.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1250000000000001e-06 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95927 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198272+0000", 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0013131670000000001, 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052829879999999997, 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95927 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198272+0000", 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198272+0000", 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198272+0000", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198274+0000", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2529999999999999e-06 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198280+0000", 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7479999999999999e-06 2024-09-21T13:58:52.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198284+0000", 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4299999999999999e-06 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96250 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199157+0000", 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00042846799999999999, 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044443909999999998, 2024-09-21T13:58:52.494 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96250 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199157+0000", 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199157+0000", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199156+0000", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199159+0000", 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199165+0000", 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9190000000000004e-06 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199169+0000", 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4700000000000004e-06 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96292 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200024+0000", 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9995608, 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0036050119999999999, 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96292 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200024+0000", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200024+0000", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200024+0000", 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200026+0000", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6199999999999999e-06 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200033+0000", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3130000000000004e-06 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200038+0000", 2024-09-21T13:58:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9869999999999999e-06 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95843 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194373+0000", 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0052122130000000003, 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092866249999999997, 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95843 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194373+0000", 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194373+0000", 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194373+0000", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194374+0000", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1990000000000001e-06 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194377+0000", 2024-09-21T13:58:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9579999999999999e-06 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194380+0000", 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4660000000000002e-06 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95929 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198304+0000", 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001281489, 2024-09-21T13:58:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005409161, 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95929 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198304+0000", 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198304+0000", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198303+0000", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198306+0000", 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7970000000000001e-06 2024-09-21T13:58:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198312+0000", 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1789999999999996e-06 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198317+0000", 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9200000000000003e-06 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96251 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199173+0000", 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00041221900000000002, 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046007620000000004, 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96251 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199173+0000", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199173+0000", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199173+0000", 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199175+0000", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3300000000000001e-06 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199181+0000", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.767e-06 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199185+0000", 2024-09-21T13:58:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4909999999999999e-06 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96293 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200056+0000", 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9995289, 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037733559999999998, 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96293 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200056+0000", 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200056+0000", 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200056+0000", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200059+0000", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8320000000000002e-06 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200065+0000", 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0759999999999999e-06 2024-09-21T13:58:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200070+0000", 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9080000000000003e-06 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95844 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194399+0000", 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051867010000000002, 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094717459999999996, 2024-09-21T13:58:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95844 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194399+0000", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194399+0000", 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194398+0000", 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194400+0000", 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3540000000000001e-06 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194405+0000", 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0989999999999998e-06 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194407+0000", 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6759999999999999e-06 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95931 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198327+0000", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0012583620000000001, 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055708629999999997, 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95931 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198327+0000", 2024-09-21T13:58:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198327+0000", 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198326+0000", 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198329+0000", 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.447e-06 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198335+0000", 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2219999999999999e-06 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198340+0000", 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6670000000000004e-06 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96252 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199212+0000", 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00037289199999999999, 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047208409999999999, 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96252 2024-09-21T13:58:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199212+0000", 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199212+0000", 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199212+0000", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199215+0000", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6510000000000001e-06 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199221+0000", 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2779999999999999e-06 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199226+0000", 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.011e-06 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96294 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200081+0000", 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9995046, 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039090119999999999, 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96294 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200081+0000", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200081+0000", 2024-09-21T13:58:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200080+0000", 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200083+0000", 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.554e-06 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200094+0000", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1851999999999999e-05 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200100+0000", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.276e-06 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95846 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194410+0000", 2024-09-21T13:58:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051756249999999997, 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096368159999999994, 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95846 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194410+0000", 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194410+0000", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194409+0000", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194411+0000", 2024-09-21T13:58:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.153e-06 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194415+0000", 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6789999999999996e-06 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194419+0000", 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5030000000000002e-06 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95933 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198364+0000", 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0012209460000000001, 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005741459, 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95933 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198364+0000", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198364+0000", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198364+0000", 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198367+0000", 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1580000000000001e-06 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198374+0000", 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1180000000000003e-06 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198380+0000", 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8930000000000002e-06 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96253 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199230+0000", 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00035507399999999998, 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049047079999999998, 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96253 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199230+0000", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199230+0000", 2024-09-21T13:58:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199230+0000", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199232+0000", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.604e-06 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199238+0000", 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6910000000000002e-06 2024-09-21T13:58:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199243+0000", 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.668e-06 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96296 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200112+0000", 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9994731, 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0040542080000000001, 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96296 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200112+0000", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200112+0000", 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200112+0000", 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200114+0000", 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4700000000000001e-06 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200120+0000", 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8680000000000004e-06 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200125+0000", 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9799999999999998e-06 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95848 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194421+0000", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051644910000000002, 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097890070000000006, 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95848 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194421+0000", 2024-09-21T13:58:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194421+0000", 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194421+0000", 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194422+0000", 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.203e-06 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194425+0000", 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.745e-06 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194427+0000", 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96220 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198385+0000", 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001200535, 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058824589999999996, 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96220 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198385+0000", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198385+0000", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198384+0000", 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198387+0000", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3769999999999999e-06 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198392+0000", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720000000000002e-06 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198397+0000", 2024-09-21T13:58:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5589999999999999e-06 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96254 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199259+0000", 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.000326213, 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050637479999999999, 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96254 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199259+0000", 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199259+0000", 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199259+0000", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199261+0000", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5670000000000002e-06 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199267+0000", 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3239999999999999e-06 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199273+0000", 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6500000000000001e-06 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96334 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200129+0000", 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9994564, 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004247949, 2024-09-21T13:58:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96334 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200129+0000", 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200129+0000", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200129+0000", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200131+0000", 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.182e-06 2024-09-21T13:58:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200136+0000", 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7729999999999996e-06 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200141+0000", 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7829999999999998e-06 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95851 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194447+0000", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051381489999999998, 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0099592829999999993, 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95851 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194447+0000", 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194447+0000", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194447+0000", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194448+0000", 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3820000000000001e-06 2024-09-21T13:58:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194453+0000", 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8899999999999998e-06 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194457+0000", 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96221 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198411+0000", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001174156, 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060256270000000004, 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96221 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198411+0000", 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198411+0000", 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198411+0000", 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198413+0000", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5830000000000001e-06 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198419+0000", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198424+0000", 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96255 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199278+0000", 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00030768599999999999, 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052059100000000002, 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96255 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199278+0000", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199278+0000", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199277+0000", 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199280+0000", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4940000000000002e-06 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199286+0000", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3269999999999997e-06 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199291+0000", 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6020000000000002e-06 2024-09-21T13:58:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96335 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200145+0000", 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9994402, 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043972100000000004, 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96335 2024-09-21T13:58:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200145+0000", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200145+0000", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200145+0000", 2024-09-21T13:58:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200147+0000", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2180000000000002e-06 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200153+0000", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8699999999999997e-06 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200158+0000", 2024-09-21T13:58:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6099999999999999e-06 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95856 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194459+0000", 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051264049999999997, 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010140906999999999, 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95856 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194459+0000", 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194459+0000", 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194459+0000", 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194460+0000", 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1090000000000001e-06 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194463+0000", 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8739999999999999e-06 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194465+0000", 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6070000000000002e-06 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96222 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198442+0000", 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0011434010000000001, 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006202857, 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96222 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198442+0000", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198442+0000", 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198441+0000", 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198444+0000", 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.667e-06 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198450+0000", 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3820000000000001e-06 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198455+0000", 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.724e-06 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96256 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199304+0000", 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00028143500000000002, 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053710210000000001, 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96256 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199304+0000", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199304+0000", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199303+0000", 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199306+0000", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4210000000000002e-06 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199312+0000", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3319999999999997e-06 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199317+0000", 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7589999999999997e-06 2024-09-21T13:58:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96336 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200161+0000", 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.999424, 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045419659999999997, 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96336 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200161+0000", 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200161+0000", 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200161+0000", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200163+0000", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.995e-06 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200170+0000", 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9430000000000003e-06 2024-09-21T13:58:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200175+0000", 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8709999999999996e-06 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95860 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194468+0000", 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051173210000000002, 2024-09-21T13:58:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01028856, 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95860 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194468+0000", 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194468+0000", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194468+0000", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194469+0000", 2024-09-21T13:58:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194472+0000", 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8739999999999999e-06 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194474+0000", 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5509999999999998e-06 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96223 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198470+0000", 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001115261, 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0063469119999999997, 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96223 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198470+0000", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198470+0000", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198470+0000", 2024-09-21T13:58:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198472+0000", 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8619999999999999e-06 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198479+0000", 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5289999999999997e-06 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198484+0000", 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5909999999999998e-06 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96257 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199335+0000", 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00024988700000000001, 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055405849999999998, 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96257 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199335+0000", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199335+0000", 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199335+0000", 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199340+0000", 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3140000000000003e-06 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199347+0000", 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5350000000000001e-06 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199352+0000", 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96337 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200180+0000", 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9994054, 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047411179999999999, 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96337 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200180+0000", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200180+0000", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200180+0000", 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200182+0000", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-06 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200188+0000", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8139999999999997e-06 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200192+0000", 2024-09-21T13:58:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2860000000000001e-06 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95862 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.194477+0000", 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051086869999999998, 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010476173, 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95862 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194477+0000", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194477+0000", 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194476+0000", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194478+0000", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.108e-06 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194480+0000", 2024-09-21T13:58:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9749999999999999e-06 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194483+0000", 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5399999999999998e-06 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96224 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198488+0000", 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0010973689999999999, 2024-09-21T13:58:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0064922399999999998, 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96224 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198488+0000", 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198488+0000", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198487+0000", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198490+0000", 2024-09-21T13:58:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4389999999999999e-06 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198496+0000", 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8459999999999996e-06 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198502+0000", 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8429999999999998e-06 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96258 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199356+0000", 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.000228829, 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056764420000000003, 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96258 2024-09-21T13:58:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199356+0000", 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199356+0000", 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199356+0000", 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199358+0000", 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4320000000000002e-06 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199364+0000", 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9150000000000001e-06 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199369+0000", 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96338 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200196+0000", 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9993892, 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048928720000000004, 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96338 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200196+0000", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200196+0000", 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200196+0000", 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200198+0000", 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.351e-06 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200204+0000", 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4360000000000001e-06 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200209+0000", 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5979999999999996e-06 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95867 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197671+0000", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0019142250000000001, 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007477544, 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95867 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197671+0000", 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197671+0000", 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.194490+0000", 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9968185 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197676+0000", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031864089999999999 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197687+0000", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0718e-05 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197694+0000", 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96225 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198517+0000", 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0010684659999999999, 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0066717549999999997, 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96225 2024-09-21T13:58:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198517+0000", 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198517+0000", 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198516+0000", 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198519+0000", 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4269999999999998e-06 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198526+0000", 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9469999999999997e-06 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198531+0000", 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1739999999999999e-06 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96259 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199373+0000", 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00021212600000000001, 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058431840000000004, 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96259 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199373+0000", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199373+0000", 2024-09-21T13:58:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199373+0000", 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199375+0000", 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3e-06 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199381+0000", 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7760000000000003e-06 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199387+0000", 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4629999999999998e-06 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96339 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200219+0000", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9993658, 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050330490000000004, 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96339 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200219+0000", 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200219+0000", 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200219+0000", 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200221+0000", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4269999999999998e-06 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200227+0000", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0510000000000002e-06 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200232+0000", 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7360000000000001e-06 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:95875 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.197701+0000", 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001884759, 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0076078739999999997, 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 95875 2024-09-21T13:58:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197701+0000", 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197701+0000", 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197700+0000", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197706+0000", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2149999999999998e-06 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197713+0000", 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3820000000000001e-06 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.197718+0000", 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1189999999999996e-06 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96226 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.198557+0000", 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0010283410000000001, 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068100269999999997, 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96226 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198557+0000", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198557+0000", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198556+0000", 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198559+0000", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6699999999999998e-06 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198567+0000", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6450000000000005e-06 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.198572+0000", 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999996e-06 2024-09-21T13:58:52.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96260 3.18 3.5579c338 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.199405+0000", 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00017998800000000001, 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060173969999999999, 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96260 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199405+0000", 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199405+0000", 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199405+0000", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199407+0000", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5220000000000002e-06 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199414+0000", 2024-09-21T13:58:52.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9269999999999999e-06 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.199419+0000", 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.062e-06 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:96340 3.18 3.35d66c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.200236+0000", 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9993491, 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052231719999999999, 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 96340 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200236+0000", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200236+0000", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200236+0000", 2024-09-21T13:58:52.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200238+0000", 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4679999999999999e-06 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200244+0000", 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8370000000000002e-06 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:52.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.200249+0000", 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8810000000000004e-06 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 129 2024-09-21T13:58:52.636 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:52.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:58:52.638 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:52.635+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:52.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:52.738 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:52.735+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:52.839 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:52.835+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:52.844 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:52.844 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:52.844 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:52.844 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:52.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:52.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:52.938+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:53.041 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:53.038+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.65082486, 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:58:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.610738022, 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.549424766, 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43373 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9273344~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.4804325199999999, 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057399824000000002, 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43373 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571969+0000", 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571971+0000", 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.875e-06 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571977+0000", 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6869999999999999e-06 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571981+0000", 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3780000000000003e-06 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624831+0000", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052849396 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624906+0000", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5488999999999995e-05 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.629369+0000", 2024-09-21T13:58:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044633140000000003 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102380 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9875456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.259271423, 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057339228999999999, 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102380 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793130+0000", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793133+0000", 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-21T13:58:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793138+0000", 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793143+0000", 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3590000000000001e-06 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.848975+0000", 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055832765999999999 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850324+0000", 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001348309 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850470+0000", 2024-09-21T13:58:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146329 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102381 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9891840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25925569100000001, 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057520040000000001, 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102381 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793148+0000", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793154+0000", 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4110000000000004e-06 2024-09-21T13:58:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793159+0000", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8599999999999998e-06 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850503+0000", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057343425000000003 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850566+0000", 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3372000000000002e-05 2024-09-21T13:58:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850666+0000", 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100212 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102393 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10088448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.255347504, 2024-09-21T13:58:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055791436999999999, 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102393 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797054+0000", 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797057+0000", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3829999999999999e-06 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797063+0000", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4470000000000003e-06 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797068+0000", 2024-09-21T13:58:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7219999999999999e-06 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852711+0000", 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055643445999999999 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852754+0000", 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2633000000000003e-05 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852846+0000", 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2275000000000007e-05 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102394 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10104832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25533004999999998, 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055942143999999999, 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102394 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797074+0000", 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3889999999999999e-06 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797080+0000", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6250000000000004e-06 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797084+0000", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852873+0000", 2024-09-21T13:58:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055788991000000003 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852953+0000", 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9758000000000004e-05 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853014+0000", 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1320000000000002e-05 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102395 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10121216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.255314237, 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056134649000000002, 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102395 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797089+0000", 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9309999999999998e-06 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797095+0000", 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5940000000000001e-06 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797099+0000", 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2860000000000001e-06 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853039+0000", 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055939163 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853133+0000", 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4854999999999999e-05 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853223+0000", 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9145000000000001e-05 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102396 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10137600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25529887699999998, 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056318565000000001, 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102396 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797105+0000", 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2350000000000002e-06 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797111+0000", 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797116+0000", 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2939999999999999e-06 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853254+0000", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056138331999999999 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853333+0000", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9363999999999994e-05 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853422+0000", 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8350999999999995e-05 2024-09-21T13:58:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102397 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10153984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.255282646, 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056598471999999997, 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102397 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797148+0000", 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8821000000000001e-05 2024-09-21T13:58:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797156+0000", 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7049999999999999e-06 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797161+0000", 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2079999999999999e-06 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853453+0000", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056292498000000003 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853548+0000", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4247999999999996e-05 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853718+0000", 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017028200000000001 2024-09-21T13:58:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102398 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10170368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25523518299999998, 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056775582999999998, 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102398 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797166+0000", 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797169+0000", 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4320000000000002e-06 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797174+0000", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4659999999999998e-06 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797179+0000", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6589999999999998e-06 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853752+0000", 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056573343999999998 2024-09-21T13:58:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853849+0000", 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6674000000000003e-05 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853943+0000", 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3474999999999995e-05 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102399 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10186752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25516973199999998, 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882133000000001, 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102399 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797235+0000", 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5809999999999999e-06 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797239+0000", 2024-09-21T13:58:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3579999999999996e-06 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797244+0000", 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6979999999999997e-06 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853970+0000", 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056726625000000003 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854044+0000", 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3677999999999995e-05 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854115+0000", 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0605999999999995e-05 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102400 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10203136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25515418699999998, 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057075064000000002, 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102400 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797250+0000", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1550000000000001e-06 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797256+0000", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797260+0000", 2024-09-21T13:58:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5120000000000002e-06 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854142+0000", 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882017999999999 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854238+0000", 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6197000000000001e-05 2024-09-21T13:58:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854323+0000", 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4507999999999998e-05 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102401 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10219520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.255136221, 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252537999999999, 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102401 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797268+0000", 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2989999999999999e-06 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797274+0000", 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8039999999999998e-06 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797278+0000", 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.544e-06 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854350+0000", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057071380999999997 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854430+0000", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0665000000000001e-05 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854518+0000", 2024-09-21T13:58:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8172999999999998e-05 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102402 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10235904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25512002099999997, 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057430862999999999, 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102402 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797284+0000", 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9690000000000001e-06 2024-09-21T13:58:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797289+0000", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4310000000000002e-06 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797294+0000", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5539999999999999e-06 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854546+0000", 2024-09-21T13:58:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252270000000001 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854610+0000", 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3577000000000005e-05 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854713+0000", 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103304 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102414 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10432512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25120604800000002, 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055926550999999998, 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102414 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801199+0000", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9409999999999999e-06 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801205+0000", 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801210+0000", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9219999999999996e-06 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.856973+0000", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055763004999999997 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857040+0000", 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7890000000000002e-05 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857123+0000", 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2206999999999994e-05 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102415 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10448896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25118827300000002, 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056684905000000001, 2024-09-21T13:58:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102415 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801216+0000", 2024-09-21T13:58:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801221+0000", 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5300000000000004e-06 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801226+0000", 2024-09-21T13:58:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4989999999999996e-06 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857741+0000", 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056515507999999999 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857811+0000", 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0222999999999995e-05 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857899+0000", 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7390000000000002e-05 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102416 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10465280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.25117257500000001, 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056878169999999999, 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102416 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801229+0000", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801232+0000", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5050000000000002e-06 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801239+0000", 2024-09-21T13:58:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.985e-06 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801244+0000", 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7879999999999997e-06 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857939+0000", 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056695027000000002 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858019+0000", 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0493000000000003e-05 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858108+0000", 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8691999999999997e-05 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102417 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10481664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.251154286, 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057035644000000003, 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102417 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801250+0000", 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3020000000000002e-06 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801255+0000", 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6799999999999998e-06 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801260+0000", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5979999999999999e-06 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858134+0000", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056874307999999998 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858202+0000", 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7126999999999996e-05 2024-09-21T13:58:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858283+0000", 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1959999999999995e-05 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:53.147 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:53.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:53.149 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:53.146+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:53.249 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:53.246+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:53.273 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:53.273 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:53.273 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:53.273 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:53.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:53.350 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:53.347+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:53.370 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:58:53.424 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:53.424 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:53.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:53.446 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T13:58:53.446 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.7 2024-09-21T13:58:53.446 INFO:tasks.thrashosds.thrasher:remote for osd 7 is ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T13:58:53.446 DEBUG:teuthology.orchestra.run.smithi134:> type ceph-objectstore-tool 2024-09-21T13:58:53.485 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:53.483+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:53.489 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-21T13:58:53.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op list-pgs 2024-09-21T13:58:53.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:53.581 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:53.579+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8222405530000003, 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8221708940000001, 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:58:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:58:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8220683180000004, 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:58:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8219380489999999, 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8218708599999998, 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:58:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:58:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8217648940000002, 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8216103849999996, 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8215558090000004, 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:58:53.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8214563930000001, 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:58:53.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8213122669999997, 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8212489380000001, 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:58:53.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8211494120000005, 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:58:53.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:58:53.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8210057930000003, 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:58:53.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8209613300000003, 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.820847251, 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:53.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:58:53.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8207119519999999, 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:58:53.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:58:53.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8204060139999996, 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.701 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:58:53.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:58:53.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8200759140000002, 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8197874719999998, 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.712 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.8195333539999998, 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:58:53.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:53.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:53.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:53.717 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:53.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:53.718 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:53.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:53.718+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:53.719 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:53.724 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:53.724 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:53.747 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:53.747 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:53.775 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:53.776 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:53.802 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:53.802 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:53.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-21T13:58:53.819 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:53.818+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:53.833 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:53.833 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:53.863 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:53.864 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:58:53.868 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:58:53.868 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:58:53.920 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:53.918+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:53.923 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:53.923 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:53.942 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:54.021 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:54.019+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:54.070 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:54.070 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:54.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:54.121 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:54.118+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:54.223 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:54.223+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:54.225 INFO:teuthology.orchestra.run.smithi079.stdout:1479 trunc from 0xe4a2ba1 to 0x80ee60c 2024-09-21T13:58:54.254 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:54.254 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:54.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:54.270 INFO:teuthology.orchestra.run.smithi079.stdout:1481 write 0xdbf296a thru 0xdbfbf54 (0x95eb bytes) 2024-09-21T13:58:54.284 INFO:teuthology.orchestra.run.smithi079.stdout:1482 trunc from 0xdbfbf55 to 0x7e72753 2024-09-21T13:58:54.304 INFO:teuthology.orchestra.run.smithi079.stdout:1484 read 0xc61bd0 thru 0xc6c66d (0xaa9e bytes) 2024-09-21T13:58:54.309 INFO:teuthology.orchestra.run.smithi079.stdout:1485 trunc from 0x7e72753 to 0x4b459cf 2024-09-21T13:58:54.336 INFO:teuthology.orchestra.run.smithi079.stdout:1486 read 0x78d241 thru 0x799941 (0xc701 bytes) 2024-09-21T13:58:54.338 INFO:teuthology.orchestra.run.smithi079.stdout:1487 punch from 0x1ef2f90 to 0x1f005e5, (0xd655 bytes) 2024-09-21T13:58:54.338 INFO:teuthology.orchestra.run.smithi079.stdout:1488 read 0x288484c thru 0x28851c5 (0x97a bytes) 2024-09-21T13:58:54.338 INFO:teuthology.orchestra.run.smithi079.stdout:1489 write 0x20d91eb thru 0x20e48f7 (0xb70d bytes) 2024-09-21T13:58:54.352 INFO:teuthology.orchestra.run.smithi079.stdout:1490 punch from 0x21bb3d3 to 0x21c8c0a, (0xd837 bytes) 2024-09-21T13:58:54.353 INFO:teuthology.orchestra.run.smithi079.stdout:1491 read 0x1d61583 thru 0x1d63c1c (0x269a bytes) 2024-09-21T13:58:54.353 INFO:teuthology.orchestra.run.smithi079.stdout:1492 read 0x32379d0 thru 0x324336f (0xb9a0 bytes) 2024-09-21T13:58:54.355 INFO:teuthology.orchestra.run.smithi079.stdout:1494 read 0x3ca9e32 thru 0x3cab2df (0x14ae bytes) 2024-09-21T13:58:54.356 INFO:teuthology.orchestra.run.smithi079.stdout:1495 trunc from 0x4b459cf to 0x4b27ebf 2024-09-21T13:58:54.357 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:54.359+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:54.366 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.367 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.401 INFO:teuthology.orchestra.run.smithi079.stdout:1499 write 0xeb0f0e4 thru 0xeb1d1da (0xe0f7 bytes) 2024-09-21T13:58:54.407 INFO:teuthology.orchestra.run.smithi079.stdout:1503 write 0x78e84f6 thru 0x78ea635 (0x2140 bytes) 2024-09-21T13:58:54.412 INFO:teuthology.orchestra.run.smithi079.stdout:1505 write 0xc9f1d89 thru 0xc9fc82e (0xaaa6 bytes) 2024-09-21T13:58:54.419 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.419 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.419 INFO:teuthology.orchestra.run.smithi079.stdout:1511 write 0xb472071 thru 0xb47e013 (0xbfa3 bytes) 2024-09-21T13:58:54.424 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:54.423+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:54.424 INFO:teuthology.orchestra.run.smithi079.stdout:1512 writesame 0x40f0f6b thru 0x40f5b69 data_size 0x5(0x4bff bytes) 2024-09-21T13:58:54.437 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.437 INFO:teuthology.orchestra.run.smithi079.stdout:1516 writesame 0x42189d thru 0x42aa28 data_size 0x51(0x918c bytes) 2024-09-21T13:58:54.445 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:54.446 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:54.455 INFO:teuthology.orchestra.run.smithi079.stdout:1517 writesame 0xb1fa9c5 thru 0xb1fe065 data_size 0x1(0x36a1 bytes) 2024-09-21T13:58:54.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:54.478 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.479 INFO:teuthology.orchestra.run.smithi079.stdout:1520 punch from 0xdeaec8c to 0xdebb132, (0xc4a6 bytes) 2024-09-21T13:58:54.479 INFO:teuthology.orchestra.run.smithi079.stdout:1521 punch from 0x4204f7a to 0x42138b5, (0xe93b bytes) 2024-09-21T13:58:54.479 INFO:teuthology.orchestra.run.smithi079.stdout:1522 writesame 0x63b4400 thru 0x63c005c data_size 0x1(0xbc5d bytes) 2024-09-21T13:58:54.527 INFO:teuthology.orchestra.run.smithi079.stdout:1523 write 0x3002fd0 thru 0x3005010 (0x2041 bytes) 2024-09-21T13:58:54.535 INFO:teuthology.orchestra.run.smithi079.stdout:1524 writesame 0x834bbea thru 0x835a4de data_size 0x3(0xe8f5 bytes) 2024-09-21T13:58:54.557 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.557 INFO:teuthology.orchestra.run.smithi079.stdout:1526 read 0x4cf905a thru 0x4d045d9 (0xb580 bytes) 2024-09-21T13:58:54.558 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:54.559+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:54.559 INFO:teuthology.orchestra.run.smithi079.stdout:1529 punch from 0x459d6bf to 0x45acced, (0xf62e bytes) 2024-09-21T13:58:54.559 INFO:teuthology.orchestra.run.smithi079.stdout:1531 write 0xb4df672 thru 0xb4eb48b (0xbe1a bytes) 2024-09-21T13:58:54.566 INFO:teuthology.orchestra.run.smithi079.stdout:1532 read 0x16e11b8 thru 0x16e85ab (0x73f4 bytes) 2024-09-21T13:58:54.568 INFO:teuthology.orchestra.run.smithi079.stdout:1533 read 0xeb18969 thru 0xeb1d1da (0x4872 bytes) 2024-09-21T13:58:54.569 INFO:teuthology.orchestra.run.smithi079.stdout:1534 write 0xe5dc20d thru 0xe5e69ef (0xa7e3 bytes) 2024-09-21T13:58:54.576 INFO:teuthology.orchestra.run.smithi079.stdout:1535 read 0x88a3c2c thru 0x88ae263 (0xa638 bytes) 2024-09-21T13:58:54.576 INFO:teuthology.orchestra.run.smithi079.stdout:1537 punch from 0xd02551b to 0xd02a3b6, (0x4e9b bytes) 2024-09-21T13:58:54.576 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.576 INFO:teuthology.orchestra.run.smithi079.stdout:1541 write 0x3ce153b thru 0x3ce6774 (0x523a bytes) 2024-09-21T13:58:54.590 INFO:teuthology.orchestra.run.smithi079.stdout:1542 writesame 0xd81e1ac thru 0xd82a7fb data_size 0x13(0xc650 bytes) 2024-09-21T13:58:54.606 INFO:teuthology.orchestra.run.smithi079.stdout:1543 trunc from 0xeb1d1db to 0xcd55dd2 2024-09-21T13:58:54.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:54.622+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:54.629 INFO:teuthology.orchestra.run.smithi079.stdout:1544 trunc from 0xcd55dd2 to 0xd46b345 2024-09-21T13:58:54.632 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:54.632 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:54.638 INFO:teuthology.orchestra.run.smithi079.stdout:1545 read 0x42b27e2 thru 0x42bd1a6 (0xa9c5 bytes) 2024-09-21T13:58:54.639 INFO:teuthology.orchestra.run.smithi079.stdout:1546 writesame 0x6304fd0 thru 0x631010e data_size 0x7d(0xb13f bytes) 2024-09-21T13:58:54.645 INFO:teuthology.orchestra.run.smithi079.stdout:1547 writesame 0xc5550e9 thru 0xc55a4c2 data_size 0x1(0x53da bytes) 2024-09-21T13:58:54.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:54.657 INFO:teuthology.orchestra.run.smithi079.stdout:1548 read 0x49eef77 thru 0x49efd1d (0xda7 bytes) 2024-09-21T13:58:54.658 INFO:teuthology.orchestra.run.smithi079.stdout:1549 punch from 0x6038439 to 0x603db01, (0x56c8 bytes) 2024-09-21T13:58:54.658 INFO:teuthology.orchestra.run.smithi079.stdout:1550 writesame 0x35c8e91 thru 0x35cac01 data_size 0x1(0x1d71 bytes) 2024-09-21T13:58:54.676 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.676 INFO:teuthology.orchestra.run.smithi079.stdout:1552 read 0x2f6892e thru 0x2f71cc2 (0x9395 bytes) 2024-09-21T13:58:54.677 INFO:teuthology.orchestra.run.smithi079.stdout:1553 read 0x8ca14ae thru 0x8cafe02 (0xe955 bytes) 2024-09-21T13:58:54.687 INFO:teuthology.orchestra.run.smithi079.stdout:1554 trunc from 0xd46b345 to 0xa0ecc36 2024-09-21T13:58:54.705 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.705 INFO:teuthology.orchestra.run.smithi079.stdout:1556 read 0x3bebc73 thru 0x3bf3261 (0x75ef bytes) 2024-09-21T13:58:54.707 INFO:teuthology.orchestra.run.smithi079.stdout:1559 write 0x152281b thru 0x15312d4 (0xeaba bytes) 2024-09-21T13:58:54.720 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:54.720 INFO:teuthology.orchestra.run.smithi079.stdout:1565 write 0x133569 thru 0x137fa2 (0x4a3a bytes) 2024-09-21T13:58:54.730 INFO:teuthology.orchestra.run.smithi079.stdout:1566 read 0x8b3c6d9 thru 0x8b417a4 (0x50cc bytes) 2024-09-21T13:58:54.730 INFO:teuthology.orchestra.run.smithi079.stdout:1567 write 0x142ed45 thru 0x14337d2 (0x4a8e bytes) 2024-09-21T13:58:54.733 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:54.735+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:54.763 INFO:teuthology.orchestra.run.smithi079.stdout:1568 write 0xd5f5df5 thru 0xd5fa08f (0x429b bytes) 2024-09-21T13:58:54.770 INFO:teuthology.orchestra.run.smithi079.stdout:1569 writesame 0xa7688a1 thru 0xa774474 data_size 0x6(0xbbd4 bytes) 2024-09-21T13:58:54.783 INFO:teuthology.orchestra.run.smithi079.stdout:1570 punch from 0xe46fcd to 0xe4ed4d, (0x7d80 bytes) 2024-09-21T13:58:54.783 INFO:teuthology.orchestra.run.smithi079.stdout:1571 read 0xa4a5df8 thru 0xa4b1c2e (0xbe37 bytes) 2024-09-21T13:58:54.783 INFO:teuthology.orchestra.run.smithi079.stdout:1572 punch from 0x74814d7 to 0x74866c0, (0x51e9 bytes) 2024-09-21T13:58:54.783 INFO:teuthology.orchestra.run.smithi079.stdout:1574 writesame 0x544eea9 thru 0x54527d6 data_size 0xd(0x392e bytes) 2024-09-21T13:58:54.783 INFO:teuthology.orchestra.run.smithi134.stdout:3.f 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.e 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.d 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.7 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.8 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.16 2024-09-21T13:58:54.784 INFO:teuthology.orchestra.run.smithi134.stdout:3.13 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:3.12 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:3.11 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:3.15 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:2.7 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:2.5 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:3.14 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:2.0 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:2.4 2024-09-21T13:58:54.785 INFO:teuthology.orchestra.run.smithi134.stdout:1.0 2024-09-21T13:58:54.790 INFO:teuthology.orchestra.run.smithi079.stdout:1575 trunc from 0xd5fa090 to 0xd126451 2024-09-21T13:58:54.807 INFO:teuthology.orchestra.run.smithi079.stdout:1577 writesame 0xa0bcf36 thru 0xa0c09cf data_size 0xd(0x3a9a bytes) 2024-09-21T13:58:54.813 INFO:teuthology.orchestra.run.smithi079.stdout:1578 punch from 0xaeb009 to 0xaee666, (0x365d bytes) 2024-09-21T13:58:54.814 INFO:teuthology.orchestra.run.smithi079.stdout:1579 read 0x3c6ab8c thru 0x3c77f58 (0xd3cd bytes) 2024-09-21T13:58:54.815 INFO:teuthology.orchestra.run.smithi079.stdout:1580 flatten 2024-09-21T13:58:54.820 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:54.820 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:54.827 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:54.827+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:54.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:54.928 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:54.926+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:55.028 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.028 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.029 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:55.026+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:55.041 INFO:teuthology.orchestra.run.smithi079.stdout:1581 writesame 0x52c42e thru 0x52e20d data_size 0x10(0x1de0 bytes) 2024-09-21T13:58:55.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:55.045 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.045 INFO:teuthology.orchestra.run.smithi079.stdout:1583 writesame 0x9f876ab thru 0x9f8fa29 data_size 0x31(0x837f bytes) 2024-09-21T13:58:55.049 INFO:teuthology.orchestra.run.smithi079.stdout:1585 read 0x1747ca0 thru 0x174b025 (0x3386 bytes) 2024-09-21T13:58:55.049 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.049 INFO:teuthology.orchestra.run.smithi079.stdout:1587 punch from 0x699ab47 to 0x69a54b3, (0xa96c bytes) 2024-09-21T13:58:55.049 INFO:teuthology.orchestra.run.smithi079.stdout:1588 write 0x5e25f07 thru 0x5e2e36e (0x8468 bytes) 2024-09-21T13:58:55.053 INFO:teuthology.orchestra.run.smithi079.stdout:1589 punch from 0x767cbe0 to 0x767fb7e, (0x2f9e bytes) 2024-09-21T13:58:55.053 INFO:teuthology.orchestra.run.smithi079.stdout:1590 writesame 0x982ea5d thru 0x9838493 data_size 0x25(0x9a37 bytes) 2024-09-21T13:58:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:1591 read 0x1cec942 thru 0x1cf0aec (0x41ab bytes) 2024-09-21T13:58:55.059 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.065 INFO:teuthology.orchestra.run.smithi079.stdout:1594 write 0xd2a6e15 thru 0xd2b213d (0xb329 bytes) 2024-09-21T13:58:55.072 INFO:teuthology.orchestra.run.smithi079.stdout:1595 read 0x8e4743a thru 0x8e5348d (0xc054 bytes) 2024-09-21T13:58:55.072 INFO:teuthology.orchestra.run.smithi079.stdout:1596 read 0xa78fc3f thru 0xa7998e3 (0x9ca5 bytes) 2024-09-21T13:58:55.072 INFO:teuthology.orchestra.run.smithi079.stdout:1597 read 0x828f948 thru 0x829016f (0x828 bytes) 2024-09-21T13:58:55.072 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.073 INFO:teuthology.orchestra.run.smithi079.stdout:1599 read 0x476dcad thru 0x4774543 (0x6897 bytes) 2024-09-21T13:58:55.073 INFO:teuthology.orchestra.run.smithi079.stdout:1602 write 0x81de090 thru 0x81df840 (0x17b1 bytes) 2024-09-21T13:58:55.076 INFO:teuthology.orchestra.run.smithi079.stdout:1603 writesame 0x123e1fd thru 0x124184c data_size 0x2c(0x3650 bytes) 2024-09-21T13:58:55.092 INFO:teuthology.orchestra.run.smithi079.stdout:1604 write 0xeae25e7 thru 0xeae3343 (0xd5d bytes) 2024-09-21T13:58:55.096 INFO:teuthology.orchestra.run.smithi079.stdout:1606 write 0x683c6d9 thru 0x6844191 (0x7ab9 bytes) 2024-09-21T13:58:55.101 INFO:teuthology.orchestra.run.smithi079.stdout:1607 punch from 0x36fa86a to 0x3707fa6, (0xd73c bytes) 2024-09-21T13:58:55.105 INFO:teuthology.orchestra.run.smithi079.stdout:1609 trunc from 0xeae3344 to 0xca2b56a 2024-09-21T13:58:55.116 INFO:teuthology.orchestra.run.smithi079.stdout:1610 read 0x5ab15c5 thru 0x5abeb68 (0xd5a4 bytes) 2024-09-21T13:58:55.117 INFO:teuthology.orchestra.run.smithi079.stdout:1611 write 0xf5c25d thru 0xf69a4e (0xd7f2 bytes) 2024-09-21T13:58:55.127 INFO:teuthology.orchestra.run.smithi079.stdout:1612 trunc from 0xca2b56a to 0x9fe3b2d 2024-09-21T13:58:55.129 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:55.131+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:55.145 INFO:teuthology.orchestra.run.smithi079.stdout:1614 read 0xd05ba7 thru 0xd0fca9 (0xa103 bytes) 2024-09-21T13:58:55.149 INFO:teuthology.orchestra.run.smithi079.stdout:1615 trunc from 0x9fe3b2d to 0x86de1bb 2024-09-21T13:58:55.165 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.165 INFO:teuthology.orchestra.run.smithi079.stdout:1618 read 0x296af03 thru 0x2972a56 (0x7b54 bytes) 2024-09-21T13:58:55.165 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.165 INFO:teuthology.orchestra.run.smithi079.stdout:1620 writesame 0x23ee8f5 thru 0x23ef8bd data_size 0x3(0xfc9 bytes) 2024-09-21T13:58:55.170 INFO:teuthology.orchestra.run.smithi079.stdout:1622 punch from 0x468a103 to 0x468dc97, (0x3b94 bytes) 2024-09-21T13:58:55.173 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.173 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.188 INFO:teuthology.orchestra.run.smithi079.stdout:1623 write 0xab08332 thru 0xab0cc7d (0x494c bytes) 2024-09-21T13:58:55.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:55.193 INFO:teuthology.orchestra.run.smithi079.stdout:1624 read 0xaa46c98 thru 0xaa50168 (0x94d1 bytes) 2024-09-21T13:58:55.193 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.207 INFO:teuthology.orchestra.run.smithi079.stdout:1626 write 0xc223983 thru 0xc226f31 (0x35af bytes) 2024-09-21T13:58:55.212 INFO:teuthology.orchestra.run.smithi079.stdout:1628 read 0x616d203 thru 0x6170cc8 (0x3ac6 bytes) 2024-09-21T13:58:55.212 INFO:teuthology.orchestra.run.smithi079.stdout:1629 punch from 0xb2a9d1b to 0xb2b6bf1, (0xced6 bytes) 2024-09-21T13:58:55.212 INFO:teuthology.orchestra.run.smithi079.stdout:1630 read 0x6da089c thru 0x6da0f07 (0x66c bytes) 2024-09-21T13:58:55.212 INFO:teuthology.orchestra.run.smithi079.stdout:1632 writesame 0x758a861 thru 0x7593007 data_size 0x4d(0x87a7 bytes) 2024-09-21T13:58:55.220 INFO:teuthology.orchestra.run.smithi079.stdout:1634 punch from 0x92a032b to 0x92aeb6d, (0xe842 bytes) 2024-09-21T13:58:55.220 INFO:teuthology.orchestra.run.smithi079.stdout:1635 read 0x86da17a thru 0x86e94c7 (0xf34e bytes) 2024-09-21T13:58:55.220 INFO:teuthology.orchestra.run.smithi079.stdout:1637 read 0x2b71a4d thru 0x2b73195 (0x1749 bytes) 2024-09-21T13:58:55.220 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.220 INFO:teuthology.orchestra.run.smithi079.stdout:1639 read 0x1b664c thru 0x1c494f (0xe304 bytes) 2024-09-21T13:58:55.226 INFO:teuthology.orchestra.run.smithi079.stdout:1640 trunc from 0xc226f32 to 0x7f1b4a6 2024-09-21T13:58:55.230 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:55.230+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:55.247 INFO:teuthology.orchestra.run.smithi079.stdout:1641 read 0xada474 thru 0xae4a8f (0xa61c bytes) 2024-09-21T13:58:55.247 INFO:teuthology.orchestra.run.smithi079.stdout:1642 read 0x7845d70 thru 0x784b380 (0x5611 bytes) 2024-09-21T13:58:55.247 INFO:teuthology.orchestra.run.smithi079.stdout:1644 clone 10 order 19 su 2048 sc 13 2024-09-21T13:58:55.311 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.311 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op export --pgid 3.14 --file /var/log/ceph/exp.3.14.7 2024-09-21T13:58:55.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:55.366 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:55.366+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:55.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:58:55.455 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:55.454+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:55.496 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.496 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:55.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:55.562+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:55.592 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-21T13:58:55.634 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:55.635+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:55.659 INFO:teuthology.orchestra.run.smithi079.stdout:1646 read 0x1f71ff thru 0x1fefe9 (0x7deb bytes) 2024-09-21T13:58:55.660 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.661 INFO:teuthology.orchestra.run.smithi079.stdout:1648 punch from 0x42cab46 to 0x42cfa83, (0x4f3d bytes) 2024-09-21T13:58:55.665 INFO:teuthology.orchestra.run.smithi079.stdout:1649 writesame 0x16e27e8 thru 0x16ee64c data_size 0x21(0xbe65 bytes) 2024-09-21T13:58:55.700 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.701 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.719 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:55.738 INFO:teuthology.orchestra.run.smithi079.stdout:1651 read 0x457e108 thru 0x457f7da (0x16d3 bytes) 2024-09-21T13:58:55.738 INFO:teuthology.orchestra.run.smithi079.stdout:1652 write 0x487152e thru 0x4876951 (0x5424 bytes) 2024-09-21T13:58:55.739 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:55.734+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:55.782 INFO:teuthology.orchestra.run.smithi079.stdout:1654 write 0xdde8b19 thru 0xddeb316 (0x27fe bytes) 2024-09-21T13:58:55.793 INFO:teuthology.orchestra.run.smithi079.stdout:1657 punch from 0x2ba7d45 to 0x2bb072b, (0x89e6 bytes) 2024-09-21T13:58:55.808 INFO:teuthology.orchestra.run.smithi079.stdout:1660 trunc from 0xddeb317 to 0x36bb703 2024-09-21T13:58:55.836 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:55.834+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:55.859 INFO:teuthology.orchestra.run.smithi079.stdout:1665 punch from 0x34552dd to 0x3460220, (0xaf43 bytes) 2024-09-21T13:58:55.859 INFO:teuthology.orchestra.run.smithi079.stdout:1667 write 0x30a80e2 thru 0x30a8a94 (0x9b3 bytes) 2024-09-21T13:58:55.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:58:55.872 INFO:teuthology.orchestra.run.smithi079.stdout:1668 trunc from 0x36bb703 to 0x6c8de1a 2024-09-21T13:58:55.876 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:55.876 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:1670 read 0x6776054 thru 0x67821b9 (0xc166 bytes) 2024-09-21T13:58:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:1671 read 0x1028d0b thru 0x1031724 (0x8a1a bytes) 2024-09-21T13:58:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:1673 punch from 0xae5072 to 0xaec280, (0x720e bytes) 2024-09-21T13:58:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:1675 read 0x454bf0c thru 0x455b421 (0xf516 bytes) 2024-09-21T13:58:55.893 INFO:teuthology.orchestra.run.smithi079.stdout:1676 trunc from 0x6c8de1a to 0xd94e373 2024-09-21T13:58:55.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:58:55.910 INFO:teuthology.orchestra.run.smithi079.stdout:1677 trunc from 0xd94e373 to 0x6beedc2 2024-09-21T13:58:55.929 INFO:teuthology.orchestra.run.smithi079.stdout:1678 write 0x7244fb7 thru 0x724de84 (0x8ece bytes) 2024-09-21T13:58:55.936 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:55.934+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:55.946 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:55.956 INFO:teuthology.orchestra.run.smithi079.stdout:1681 writesame 0x7e0ba93 thru 0x7e0d7c1 data_size 0x1(0x1d2f bytes) 2024-09-21T13:58:55.969 INFO:teuthology.orchestra.run.smithi079.stdout:1683 writesame 0xa7ae564 thru 0xa7b1f47 data_size 0x5f(0x39e4 bytes) 2024-09-21T13:58:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:1686 read 0xa6f2f01 thru 0xa6f7834 (0x4934 bytes) 2024-09-21T13:58:55.970 INFO:teuthology.orchestra.run.smithi079.stdout:1687 trunc from 0xa7b1f48 to 0xa9db41e 2024-09-21T13:58:55.979 INFO:teuthology.orchestra.run.smithi079.stdout:1688 clone 11 order 25 su 4194304 sc 9 2024-09-21T13:58:56.027 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:56.037 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:56.035+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:56.038 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:56.044 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:56.044 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:56.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:58:56.061 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:56.061 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:56.077 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:56.078 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:56.098 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:56.098 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:56.118 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:56.119 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:56.138 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:56.134+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:56.139 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:56.139 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:56.139 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:58:56.142 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:58:56.143 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:58:56.165 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:56.166 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:56.166 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:56.166 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:56.166 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:56.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:58:56.239 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:56.239+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:56.333 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:56.333 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:56.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.812070531, 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:58:56.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:58:56.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811958907999999, 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:58:56.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811939085000001, 2024-09-21T13:58:56.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:58:56.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:58:56.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811914906, 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:58:56.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:56.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811890801000001, 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:58:56.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:58:56.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811872292, 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811862550000001, 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:56.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811837691000001, 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:58:56.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:58:56.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:56.371 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811809014, 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:58:56.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:58:56.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811790196, 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:58:56.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:58:56.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811769525000001, 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:58:56.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:58:56.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811748454, 2024-09-21T13:58:56.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811712602, 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:58:56.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.81168038, 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:58:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:58:56.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.81164474, 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.399 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:58:56.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.403 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811610262, 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:58:56.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811555702, 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811516536999999, 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811477801000001, 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.811453048000001, 2024-09-21T13:58:56.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:58:56.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.425 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:56.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:58:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:58:56.428 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:56.427+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:56.474 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone10 from 0xa9db41e (overlap 0x36bb703) to 0x0 2024-09-21T13:58:56.527 INFO:teuthology.orchestra.run.smithi134.stderr:Exporting 3.14 info 3.14( v 41'131 (0'0,41'131] local-lis/les=23/24 n=16 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-21T13:58:56.527 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:56.527+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:56.533 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:28e320bf:::rbd_data.11854cc47015.000000000000004c:head# 2024-09-21T13:58:56.534 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:29f1eac1:::rbd_data.11855cdad4c2.000000000000003c:head# 2024-09-21T13:58:56.534 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:5# 2024-09-21T13:58:56.536 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:head# 2024-09-21T13:58:56.537 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2bb4acb3:::rbd_id.image_client.0-clone5:head# 2024-09-21T13:58:56.537 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2c5a2e4a:::rbd_data.1185bf1a1adb.0000000000000001:9# 2024-09-21T13:58:56.539 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2c5a2e4a:::rbd_data.1185bf1a1adb.0000000000000001:head# 2024-09-21T13:58:56.540 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2cd33b39:::rbd_object_map.11853c86949e:head# 2024-09-21T13:58:56.541 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2d005fad:::rbd_data.1185bf1a1adb.0000000000000007:9# 2024-09-21T13:58:56.542 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2d005fad:::rbd_data.1185bf1a1adb.0000000000000007:head# 2024-09-21T13:58:56.544 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2d2f3d79:::rbd_data.11855cdad4c2.0000000000000040:head# 2024-09-21T13:58:56.544 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2d6a3740:::rbd_data.1185a7c518d0.0000000000000183:head# 2024-09-21T13:58:56.544 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2d86fb72:::rbd_data.1185a7c518d0.000000000000019b:head# 2024-09-21T13:58:56.544 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2ec6815d:::rbd_data.1185e0e4cd61.000000000000000a:8# 2024-09-21T13:58:56.549 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2ec6815d:::rbd_data.1185e0e4cd61.000000000000000a:head# 2024-09-21T13:58:56.550 INFO:teuthology.orchestra.run.smithi134.stderr:Read #3:2eccc5cc:::rbd_data.1185a7c518d0.0000000000000116:head# 2024-09-21T13:58:56.550 INFO:teuthology.orchestra.run.smithi134.stderr:Export successful 2024-09-21T13:58:56.629 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:56.627+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:56.651 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126397 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626496+0000", 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019703327999999999, 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019726427000000001, 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126397 2024-09-21T13:58:56.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626496+0000", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626496+0000", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626496+0000", 2024-09-21T13:58:56.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626498+0000", 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3769999999999999e-06 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626504+0000", 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0449999999999997e-06 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626509+0000", 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6890000000000003e-06 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126540 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627363+0000", 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018836992, 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018929365, 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126540 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627363+0000", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627363+0000", 2024-09-21T13:58:56.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627362+0000", 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627365+0000", 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5689999999999999e-06 2024-09-21T13:58:56.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627371+0000", 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4570000000000002e-06 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627376+0000", 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8029999999999996e-06 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126676 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628053+0000", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018147097000000001, 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018293704000000001, 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126676 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628053+0000", 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628053+0000", 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628052+0000", 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628055+0000", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.384e-06 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628061+0000", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.032e-06 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628065+0000", 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5580000000000002e-06 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126398 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626513+0000", 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019686357000000002, 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019892213999999998, 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126398 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.662 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626513+0000", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626513+0000", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626513+0000", 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626519+0000", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8259999999999998e-06 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626525+0000", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0499999999999997e-06 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626530+0000", 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9239999999999998e-06 2024-09-21T13:58:56.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126541 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627381+0000", 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018818383000000001, 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019083830999999999, 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126541 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627381+0000", 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627381+0000", 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627381+0000", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627383+0000", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4949999999999998e-06 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627390+0000", 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2169999999999999e-06 2024-09-21T13:58:56.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627394+0000", 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126677 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628069+0000", 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018130621999999999, 2024-09-21T13:58:56.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018457735999999999, 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126677 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628069+0000", 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628069+0000", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628069+0000", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628071+0000", 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3149999999999999e-06 2024-09-21T13:58:56.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628077+0000", 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628081+0000", 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6859999999999997e-06 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126399 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626544+0000", 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019655312000000001, 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.02004191, 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126399 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626544+0000", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626544+0000", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626544+0000", 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626547+0000", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626553+0000", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3949999999999998e-06 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626560+0000", 2024-09-21T13:58:56.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0979999999999996e-06 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126573 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627399+0000", 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018800888000000002, 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019242905000000001, 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.675 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126573 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627399+0000", 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627399+0000", 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627398+0000", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627400+0000", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.905e-06 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627404+0000", 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4410000000000002e-06 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627407+0000", 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8119999999999999e-06 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126678 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628085+0000", 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018114465, 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018588416, 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126678 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628085+0000", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628085+0000", 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628085+0000", 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628087+0000", 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2869999999999999e-06 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628093+0000", 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8340000000000004e-06 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628098+0000", 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5430000000000004e-06 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126432 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626574+0000", 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019626231000000001, 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020147465, 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126432 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626574+0000", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626574+0000", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626573+0000", 2024-09-21T13:58:56.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626576+0000", 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.57e-06 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626582+0000", 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3119999999999999e-06 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626587+0000", 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1460000000000004e-06 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126574 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627409+0000", 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018790316000000001, 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019367564, 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126574 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627409+0000", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627409+0000", 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627409+0000", 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627411+0000", 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3209999999999999e-06 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627415+0000", 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0489999999999997e-06 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627420+0000", 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2700000000000004e-06 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126679 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628151+0000", 2024-09-21T13:58:56.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018048574000000001, 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018684056000000001, 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126679 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628151+0000", 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628151+0000", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628151+0000", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628154+0000", 2024-09-21T13:58:56.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4259999999999999e-06 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628162+0000", 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0239999999999997e-06 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628168+0000", 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8239999999999996e-06 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126434 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626591+0000", 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.01960831, 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020301791, 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126434 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626591+0000", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626591+0000", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626591+0000", 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626593+0000", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.278e-06 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626599+0000", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0279999999999997e-06 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626604+0000", 2024-09-21T13:58:56.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126575 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627439+0000", 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018760742, 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019512907999999999, 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126575 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627439+0000", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627439+0000", 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627438+0000", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627441+0000", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.588e-06 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627447+0000", 2024-09-21T13:58:56.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9939999999999997e-06 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627452+0000", 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8980000000000004e-06 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126711 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628172+0000", 2024-09-21T13:58:56.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018027293999999999, 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018837100999999998, 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126711 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628172+0000", 2024-09-21T13:58:56.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628172+0000", 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628172+0000", 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628174+0000", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4250000000000001e-06 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628182+0000", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0790000000000003e-06 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628187+0000", 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1880000000000001e-06 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126435 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626625+0000", 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019574748999999999, 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020443284999999999, 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126435 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626625+0000", 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626625+0000", 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626624+0000", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626627+0000", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7920000000000001e-06 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626634+0000", 2024-09-21T13:58:56.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5980000000000002e-06 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626639+0000", 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3190000000000002e-06 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126576 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627456+0000", 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018743758999999999, 2024-09-21T13:58:56.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019670311999999999, 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126576 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627456+0000", 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627456+0000", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627456+0000", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627461+0000", 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5169999999999999e-06 2024-09-21T13:58:56.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627484+0000", 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2331e-05 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627488+0000", 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126712 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628191+0000", 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018008652, 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018992795999999999, 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126712 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628191+0000", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628191+0000", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628191+0000", 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628193+0000", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.289e-06 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628199+0000", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9739999999999999e-06 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628205+0000", 2024-09-21T13:58:56.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3130000000000004e-06 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126789 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628913+0000", 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017286323999999999, 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018330915, 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126789 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628913+0000", 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628913+0000", 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628913+0000", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628915+0000", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1339999999999998e-06 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628921+0000", 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9290000000000003e-06 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628926+0000", 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7169999999999999e-06 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126436 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626654+0000", 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019545577000000001, 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020642710000000002, 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126436 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626654+0000", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626654+0000", 2024-09-21T13:58:56.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626654+0000", 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626656+0000", 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626663+0000", 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4400000000000002e-06 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626667+0000", 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.792e-06 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126577 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.718 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627491+0000", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018708721000000001, 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019833722000000002, 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126577 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627491+0000", 2024-09-21T13:58:56.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627491+0000", 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627491+0000", 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627493+0000", 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.784e-06 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627496+0000", 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2090000000000001e-06 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627498+0000", 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6790000000000001e-06 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126713 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628211+0000", 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017988989, 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019141304000000001, 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126713 2024-09-21T13:58:56.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628211+0000", 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628211+0000", 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628210+0000", 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628213+0000", 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1780000000000002e-06 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628220+0000", 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5769999999999996e-06 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628225+0000", 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8799999999999999e-06 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126790 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628931+0000", 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017268353, 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018447970000000001, 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126790 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628931+0000", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628931+0000", 2024-09-21T13:58:56.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628931+0000", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628933+0000", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5179999999999999e-06 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628939+0000", 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7910000000000001e-06 2024-09-21T13:58:56.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628944+0000", 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.792e-06 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126437 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626672+0000", 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019527636000000001, 2024-09-21T13:58:56.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020745001999999998, 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126437 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626672+0000", 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626672+0000", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626672+0000", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626674+0000", 2024-09-21T13:58:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5639999999999999e-06 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626680+0000", 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6080000000000003e-06 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626685+0000", 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8380000000000001e-06 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126578 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627501+0000", 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018698818999999998, 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019970819000000001, 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126578 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.732 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627501+0000", 2024-09-21T13:58:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627501+0000", 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627501+0000", 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627503+0000", 2024-09-21T13:58:56.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0159999999999998e-06 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627508+0000", 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0540000000000002e-06 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627511+0000", 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6610000000000002e-06 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126714 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628230+0000", 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017969572999999999, 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019294391000000001, 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126714 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628230+0000", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628230+0000", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628230+0000", 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628232+0000", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2649999999999999e-06 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628238+0000", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9340000000000003e-06 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628243+0000", 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.583e-06 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.744 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126791 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628948+0000", 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017251729, 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018630226999999999, 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126791 2024-09-21T13:58:56.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628948+0000", 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628948+0000", 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628948+0000", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628950+0000", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.148e-06 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628955+0000", 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6620000000000002e-06 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628960+0000", 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3109999999999999e-06 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126438 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626689+0000", 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019510530000000002, 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.02094588, 2024-09-21T13:58:56.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126438 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626689+0000", 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626689+0000", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626689+0000", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626691+0000", 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.446e-06 2024-09-21T13:58:56.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626698+0000", 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2269999999999996e-06 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626703+0000", 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6090000000000003e-06 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126579 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627517+0000", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018682540000000001, 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020171893999999999, 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126579 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627517+0000", 2024-09-21T13:58:56.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627517+0000", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627517+0000", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627519+0000", 2024-09-21T13:58:56.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627525+0000", 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4840000000000003e-06 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627529+0000", 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7530000000000001e-06 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126715 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628247+0000", 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017952843999999999, 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019476114999999999, 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126715 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628247+0000", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628247+0000", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628247+0000", 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628249+0000", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3580000000000001e-06 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628255+0000", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1199999999999999e-06 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628260+0000", 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7469999999999996e-06 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126792 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628964+0000", 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017235613, 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018812690999999999, 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126792 2024-09-21T13:58:56.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628964+0000", 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628964+0000", 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628964+0000", 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628966+0000", 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2850000000000001e-06 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628972+0000", 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7219999999999996e-06 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628976+0000", 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8219999999999997e-06 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126439 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626706+0000", 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019494125000000001, 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.02112841, 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126439 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626706+0000", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626706+0000", 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626705+0000", 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626707+0000", 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.559e-06 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626710+0000", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1970000000000001e-06 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626713+0000", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.694e-06 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126580 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627533+0000", 2024-09-21T13:58:56.764 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018666498, 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020358646000000001, 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126580 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627533+0000", 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627533+0000", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627533+0000", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627535+0000", 2024-09-21T13:58:56.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0099999999999998e-06 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627541+0000", 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627546+0000", 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2120000000000002e-06 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.767 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126716 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628264+0000", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017936022999999999, 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019690517000000001, 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126716 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628264+0000", 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628264+0000", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628263+0000", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628266+0000", 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2060000000000001e-06 2024-09-21T13:58:56.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628271+0000", 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9020000000000004e-06 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628277+0000", 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1549999999999998e-06 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.770 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126793 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628982+0000", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017217287000000001, 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019031277999999999, 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126793 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628982+0000", 2024-09-21T13:58:56.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628982+0000", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628982+0000", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628984+0000", 2024-09-21T13:58:56.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0430000000000002e-06 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628990+0000", 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628995+0000", 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7260000000000002e-06 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126440 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626716+0000", 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019483345999999999, 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021364596, 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126440 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.774 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626716+0000", 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626716+0000", 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626716+0000", 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626718+0000", 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.244e-06 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626723+0000", 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8210000000000001e-06 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626727+0000", 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2610000000000004e-06 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126581 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627564+0000", 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018636067999999999, 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020574556000000001, 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126581 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627564+0000", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627564+0000", 2024-09-21T13:58:56.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627563+0000", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627567+0000", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6100000000000002e-06 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627574+0000", 2024-09-21T13:58:56.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3839999999999999e-06 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627580+0000", 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0240000000000003e-06 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126717 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628281+0000", 2024-09-21T13:58:56.780 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017919029999999999, 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019915716999999999, 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126717 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628281+0000", 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628281+0000", 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628280+0000", 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628286+0000", 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8220000000000003e-06 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628292+0000", 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3069999999999999e-06 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628297+0000", 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9030000000000003e-06 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.783 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126794 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628999+0000", 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017200423999999999, 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019255107, 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126794 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.784 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628999+0000", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628999+0000", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628999+0000", 2024-09-21T13:58:56.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629001+0000", 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.384e-06 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629007+0000", 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6760000000000004e-06 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629012+0000", 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8940000000000001e-06 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126441 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626741+0000", 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019458453000000001, 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021586500000000002, 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.787 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126441 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626741+0000", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626741+0000", 2024-09-21T13:58:56.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626741+0000", 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626743+0000", 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2120000000000002e-06 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626756+0000", 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2894999999999999e-05 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626761+0000", 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4900000000000002e-06 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126582 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627585+0000", 2024-09-21T13:58:56.790 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018615071, 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020812365999999999, 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126582 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627585+0000", 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627585+0000", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627584+0000", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627587+0000", 2024-09-21T13:58:56.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4250000000000001e-06 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627593+0000", 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5869999999999998e-06 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627598+0000", 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8389999999999997e-06 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126718 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628302+0000", 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017898147999999999, 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020152235000000001, 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126718 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628302+0000", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628302+0000", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628301+0000", 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628303+0000", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2259999999999999e-06 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628309+0000", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0360000000000003e-06 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628314+0000", 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8590000000000004e-06 2024-09-21T13:58:56.796 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126795 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.629016+0000", 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017183635999999999, 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019493448999999999, 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.797 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126795 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629016+0000", 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629016+0000", 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629016+0000", 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629018+0000", 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1900000000000002e-06 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629024+0000", 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9750000000000004e-06 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629028+0000", 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3669999999999999e-06 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127009 3.b 3:d035780b:::rbd_data.11852774f807.000000000000001a:d [read 53248~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647502+0000", 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986978, 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010687240000000001, 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:56.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127009 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647502+0000", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647502+0000", 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647501+0000", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647505+0000", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6799999999999999e-06 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647512+0000", 2024-09-21T13:58:56.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2620000000000001e-06 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647520+0000", 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1980000000000004e-06 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648023+0000", 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050334100000000003 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:56.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648060+0000", 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7160999999999999e-05 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126442 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626765+0000", 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019434852999999998, 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021876454, 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126442 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626765+0000", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626765+0000", 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626765+0000", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626767+0000", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2350000000000002e-06 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626774+0000", 2024-09-21T13:58:56.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0840000000000003e-06 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626779+0000", 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6099999999999999e-06 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126583 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627602+0000", 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018597283999999999, 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021092593999999999, 2024-09-21T13:58:56.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126583 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627602+0000", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627602+0000", 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627602+0000", 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627604+0000", 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3889999999999999e-06 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627610+0000", 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1279999999999996e-06 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627615+0000", 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8659999999999997e-06 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.810 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126719 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628319+0000", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017881096999999999, 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020419249, 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126719 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628319+0000", 2024-09-21T13:58:56.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628319+0000", 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628318+0000", 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628320+0000", 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2699999999999999e-06 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628328+0000", 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3710000000000002e-06 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628332+0000", 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7040000000000002e-06 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126796 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.629032+0000", 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017167465999999999, 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019765069999999999, 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126796 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629032+0000", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629032+0000", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629032+0000", 2024-09-21T13:58:56.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629034+0000", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2170000000000001e-06 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629040+0000", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0530000000000003e-06 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629045+0000", 2024-09-21T13:58:56.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.882e-06 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127010 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647525+0000", 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986749, 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013280970000000001, 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127010 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647525+0000", 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647525+0000", 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647524+0000", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647527+0000", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8059999999999999e-06 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647533+0000", 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5130000000000002e-06 2024-09-21T13:58:56.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647539+0000", 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3709999999999999e-06 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126443 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626797+0000", 2024-09-21T13:58:56.820 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.01940269, 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022111781, 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126443 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626797+0000", 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626797+0000", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626797+0000", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626801+0000", 2024-09-21T13:58:56.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.087e-06 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626808+0000", 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626811+0000", 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126720 3.8 3.14b6c048 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628337+0000", 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017863173999999999, 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.020626331000000001, 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126720 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628337+0000", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628337+0000", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628336+0000", 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628338+0000", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2759999999999999e-06 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628344+0000", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7350000000000001e-06 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628349+0000", 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6789999999999996e-06 2024-09-21T13:58:56.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126797 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.629049+0000", 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.017150500999999999, 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019967114000000001, 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126797 2024-09-21T13:58:56.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629049+0000", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629049+0000", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629049+0000", 2024-09-21T13:58:56.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629051+0000", 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2560000000000001e-06 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629057+0000", 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7969999999999997e-06 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.629062+0000", 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6750000000000001e-06 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127011 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647543+0000", 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986567, 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0015280960000000001, 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127011 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647543+0000", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647543+0000", 2024-09-21T13:58:56.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647543+0000", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647545+0000", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3949999999999999e-06 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647551+0000", 2024-09-21T13:58:56.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.156e-06 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647556+0000", 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8149999999999996e-06 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.833 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126510 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626813+0000", 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019386496999999999, 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022313771, 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126510 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626813+0000", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626813+0000", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626813+0000", 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626814+0000", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3200000000000001e-06 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626817+0000", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0690000000000002e-06 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626820+0000", 2024-09-21T13:58:56.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6359999999999998e-06 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127012 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647560+0000", 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986396, 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016272249999999999, 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127012 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647560+0000", 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647560+0000", 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647560+0000", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647562+0000", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1710000000000001e-06 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647567+0000", 2024-09-21T13:58:56.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647572+0000", 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4619999999999998e-06 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126511 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626822+0000", 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019377432999999999, 2024-09-21T13:58:56.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022419749999999999, 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126511 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626822+0000", 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626822+0000", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626822+0000", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626823+0000", 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2410000000000001e-06 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626829+0000", 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4820000000000002e-06 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626833+0000", 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4209999999999997e-06 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127013 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647576+0000", 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9986243, 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001721445, 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127013 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647576+0000", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647576+0000", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647575+0000", 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647578+0000", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2500000000000001e-06 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647606+0000", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8405e-05 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647613+0000", 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0119999999999999e-06 2024-09-21T13:58:56.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126512 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626837+0000", 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019362457999999999, 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022509856000000002, 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126512 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626837+0000", 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626837+0000", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626837+0000", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626839+0000", 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.221e-06 2024-09-21T13:58:56.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626845+0000", 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5380000000000002e-06 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626849+0000", 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127014 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647618+0000", 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9985814, 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00178316, 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127014 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647618+0000", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647618+0000", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647618+0000", 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647621+0000", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8600000000000001e-06 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647627+0000", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2519999999999996e-06 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647631+0000", 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5430000000000004e-06 2024-09-21T13:58:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126513 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626853+0000", 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.01934667, 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022595611000000002, 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126513 2024-09-21T13:58:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626853+0000", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626853+0000", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626853+0000", 2024-09-21T13:58:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626855+0000", 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0049999999999999e-06 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626862+0000", 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7739999999999999e-06 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626866+0000", 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.279e-06 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126650 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627710+0000", 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018490099999999999, 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021784377000000001, 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126650 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627710+0000", 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627710+0000", 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627708+0000", 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627712+0000", 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4230000000000001e-06 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627717+0000", 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8340000000000004e-06 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627722+0000", 2024-09-21T13:58:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8099999999999997e-06 2024-09-21T13:58:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127015 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647635+0000", 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9985647, 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001914301, 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127015 2024-09-21T13:58:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647635+0000", 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647635+0000", 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647635+0000", 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647637+0000", 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0870000000000001e-06 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647642+0000", 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6450000000000002e-06 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647647+0000", 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4340000000000002e-06 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126514 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626870+0000", 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019330112, 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022733402999999999, 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126514 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626870+0000", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626870+0000", 2024-09-21T13:58:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626869+0000", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626872+0000", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2259999999999999e-06 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626876+0000", 2024-09-21T13:58:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.617e-06 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626879+0000", 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6309999999999999e-06 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126651 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627731+0000", 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018468945000000001, 2024-09-21T13:58:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.021931973, 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126651 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627731+0000", 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627731+0000", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627730+0000", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627733+0000", 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6879999999999999e-06 2024-09-21T13:58:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627739+0000", 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2319999999999998e-06 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627744+0000", 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8239999999999999e-06 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127016 3.b 3.d01eac0b (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.647651+0000", 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.998549, 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020529649999999999, 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127016 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647651+0000", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647651+0000", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647650+0000", 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647652+0000", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.187e-06 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647658+0000", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5849999999999999e-06 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.647663+0000", 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4819999999999996e-06 2024-09-21T13:58:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126515 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626883+0000", 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019317219, 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022868573999999999, 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126515 2024-09-21T13:58:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626883+0000", 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626883+0000", 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626882+0000", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626884+0000", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0600000000000002e-06 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626890+0000", 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7209999999999999e-06 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626895+0000", 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7219999999999999e-06 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126652 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627749+0000", 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018451109, 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022050281000000001, 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126652 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627749+0000", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627749+0000", 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627748+0000", 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627751+0000", 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5950000000000001e-06 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627757+0000", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8680000000000004e-06 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627761+0000", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6909999999999996e-06 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126516 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626899+0000", 2024-09-21T13:58:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019301005, 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022928599000000001, 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126516 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626899+0000", 2024-09-21T13:58:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626899+0000", 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626898+0000", 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626901+0000", 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0880000000000002e-06 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626906+0000", 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7420000000000003e-06 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626911+0000", 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8359999999999999e-06 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126653 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627777+0000", 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018423103999999999, 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022078026000000001, 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126653 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627777+0000", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627777+0000", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627776+0000", 2024-09-21T13:58:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627779+0000", 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8229999999999999e-06 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627786+0000", 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6680000000000004e-06 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627791+0000", 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8189999999999997e-06 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126517 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626926+0000", 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019274020999999999, 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023041889999999999, 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126517 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626926+0000", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626926+0000", 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626925+0000", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626928+0000", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5830000000000001e-06 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626934+0000", 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-21T13:58:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626939+0000", 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126654 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627803+0000", 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018396293000000001, 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022192805999999999, 2024-09-21T13:58:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126654 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627803+0000", 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627803+0000", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627803+0000", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627805+0000", 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:58:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627812+0000", 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3069999999999999e-06 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627817+0000", 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8040000000000001e-06 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126518 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626950+0000", 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019250060999999999, 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023075796999999999, 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126518 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626950+0000", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626950+0000", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626949+0000", 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626952+0000", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7269999999999999e-06 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626958+0000", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4590000000000003e-06 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626963+0000", 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0440000000000003e-06 2024-09-21T13:58:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126655 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627831+0000", 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.01836869, 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022221866, 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126655 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627831+0000", 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627831+0000", 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627831+0000", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627833+0000", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.926e-06 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627841+0000", 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7989999999999994e-06 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627847+0000", 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2329999999999997e-06 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126519 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626968+0000", 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019231841, 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023115014, 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126519 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626968+0000", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626968+0000", 2024-09-21T13:58:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626967+0000", 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626970+0000", 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5399999999999998e-06 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626976+0000", 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0159999999999997e-06 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626994+0000", 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8584999999999999e-05 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126656 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627857+0000", 2024-09-21T13:58:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018342699000000001, 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022280007000000001, 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126656 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627857+0000", 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627857+0000", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627856+0000", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627859+0000", 2024-09-21T13:58:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6419999999999999e-06 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627865+0000", 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3389999999999998e-06 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627870+0000", 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6190000000000002e-06 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127052 3.19 3:9f126474:::rbd_data.11852774f807.0000000000000020:d [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648443+0000", 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.997757, 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017422410000000001, 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127052 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648443+0000", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648443+0000", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648442+0000", 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648445+0000", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2170000000000001e-06 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648450+0000", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4700000000000001e-06 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648455+0000", 2024-09-21T13:58:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4299999999999999e-06 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649172+0000", 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00071750700000000004 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649220+0000", 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7865000000000003e-05 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126520 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627007+0000", 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019192632000000001, 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023215196, 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126520 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627007+0000", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627007+0000", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627007+0000", 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627010+0000", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0429999999999999e-06 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627016+0000", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5860000000000001e-06 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627021+0000", 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6999999999999999e-06 2024-09-21T13:58:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126657 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627884+0000", 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018315693000000001, 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022379959000000001, 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126657 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627884+0000", 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627884+0000", 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627884+0000", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627886+0000", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8399999999999999e-06 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627893+0000", 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4189999999999999e-06 2024-09-21T13:58:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627898+0000", 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2229999999999998e-06 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127053 3.19 3.2e2648f9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648460+0000", 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9977403, 2024-09-21T13:58:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001836685, 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127053 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648460+0000", 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648460+0000", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648459+0000", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648462+0000", 2024-09-21T13:58:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3020000000000002e-06 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648469+0000", 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6090000000000003e-06 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648475+0000", 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126533 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627025+0000", 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019174308000000001, 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023298264999999999, 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126533 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627025+0000", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627025+0000", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627025+0000", 2024-09-21T13:58:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627031+0000", 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7030000000000003e-06 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627037+0000", 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1970000000000001e-06 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627042+0000", 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.135e-06 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126658 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627914+0000", 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018285428999999999, 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022438135000000001, 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126658 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627914+0000", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627914+0000", 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627914+0000", 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627917+0000", 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7920000000000001e-06 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627923+0000", 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5420000000000002e-06 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627928+0000", 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1240000000000004e-06 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127054 3.19 3.2e2648f9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648479+0000", 2024-09-21T13:58:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9977207, 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001900524, 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127054 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648479+0000", 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648479+0000", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648479+0000", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648481+0000", 2024-09-21T13:58:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3970000000000001e-06 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648487+0000", 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0689999999999998e-06 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648492+0000", 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8930000000000004e-06 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126534 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627047+0000", 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019153027, 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023361435999999999, 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126534 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627047+0000", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627047+0000", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627046+0000", 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627049+0000", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3580000000000001e-06 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627055+0000", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0039999999999996e-06 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627059+0000", 2024-09-21T13:58:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.741e-06 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126659 3.18 3.6742b538 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627942+0000", 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018257799000000002, 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022493421, 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126659 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627942+0000", 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627942+0000", 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627941+0000", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627944+0000", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7879999999999998e-06 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627951+0000", 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-21T13:58:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627956+0000", 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3709999999999999e-06 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127055 3.19 3.2e2648f9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648496+0000", 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9977036, 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019786679999999998, 2024-09-21T13:58:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127055 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648496+0000", 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648496+0000", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648496+0000", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648498+0000", 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9700000000000002e-06 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648503+0000", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.198e-06 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648508+0000", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.758e-06 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126535 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627064+0000", 2024-09-21T13:58:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019136150000000001, 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023449438999999999, 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126535 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627064+0000", 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627064+0000", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627063+0000", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627065+0000", 2024-09-21T13:58:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4719999999999998e-06 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627071+0000", 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7960000000000001e-06 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627076+0000", 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0350000000000001e-06 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126671 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627960+0000", 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018239376000000002, 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022611837999999999, 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126671 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627960+0000", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627960+0000", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627960+0000", 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627962+0000", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5620000000000002e-06 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627969+0000", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0070000000000003e-06 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627973+0000", 2024-09-21T13:58:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.887e-06 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127056 3.19 3.2e2648f9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648511+0000", 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9976883, 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020916369999999999, 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127056 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648511+0000", 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648511+0000", 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648511+0000", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648513+0000", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0279999999999999e-06 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648519+0000", 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5650000000000001e-06 2024-09-21T13:58:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648523+0000", 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126393 3.18 3:1a31be59:::rbd_data.11852774f807.0000000000000002:d [read 69632~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626402+0000", 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019797913, 2024-09-21T13:58:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024234360999999999, 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126393 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626402+0000", 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626402+0000", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626401+0000", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626404+0000", 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4339999999999999e-06 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626411+0000", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0949999999999998e-06 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626415+0000", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4109999999999998e-06 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649684+0000", 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023268767999999999 2024-09-21T13:58:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649764+0000", 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9530999999999995e-05 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126536 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627104+0000", 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019095843000000001, 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023598699000000001, 2024-09-21T13:58:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126536 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627104+0000", 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627104+0000", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627104+0000", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627106+0000", 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5610000000000001e-06 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627113+0000", 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627118+0000", 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2599999999999996e-06 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126672 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627978+0000", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018222226000000001, 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022756767000000001, 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126672 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627978+0000", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627978+0000", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627977+0000", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627979+0000", 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1579999999999999e-06 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627985+0000", 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8660000000000002e-06 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627990+0000", 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5879999999999999e-06 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126394 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626427+0000", 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019772259, 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024334288999999999, 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126394 2024-09-21T13:58:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626427+0000", 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626427+0000", 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626427+0000", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626430+0000", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7499999999999999e-06 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626436+0000", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3470000000000004e-06 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626441+0000", 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126537 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627213+0000", 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018987173, 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023578231000000002, 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126537 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627213+0000", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627213+0000", 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627212+0000", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627216+0000", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.614e-06 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627226+0000", 2024-09-21T13:58:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0332e-05 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627299+0000", 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3034999999999994e-05 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126673 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627996+0000", 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018203384, 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022822424000000001, 2024-09-21T13:58:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126673 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627996+0000", 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627996+0000", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627996+0000", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627998+0000", 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628004+0000", 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628009+0000", 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6759999999999998e-06 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126395 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626454+0000", 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019746092999999999, 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024392904, 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126395 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626454+0000", 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626454+0000", 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626453+0000", 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626456+0000", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8669999999999998e-06 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626462+0000", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.319e-06 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626467+0000", 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1660000000000002e-06 2024-09-21T13:58:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126538 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627306+0000", 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018893658000000001, 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023569730000000001, 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126538 2024-09-21T13:58:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627306+0000", 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627306+0000", 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627305+0000", 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627309+0000", 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5880000000000002e-06 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627317+0000", 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6329999999999996e-06 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627322+0000", 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6999999999999996e-06 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126674 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628013+0000", 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018186535, 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022890112000000001, 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126674 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628013+0000", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628013+0000", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628013+0000", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628018+0000", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4419999999999997e-06 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628025+0000", 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.72e-06 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628030+0000", 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9840000000000001e-06 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127059 3.1e 3:7b891506:::rbd_data.11852774f807.0000000000000021:d [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648872+0000", 2024-09-21T13:58:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.9973273, 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002063091, 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127059 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648872+0000", 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648872+0000", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648872+0000", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648875+0000", 2024-09-21T13:58:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4010000000000001e-06 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648882+0000", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2169999999999997e-06 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648888+0000", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9020000000000004e-06 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649610+0000", 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00072137600000000003 2024-09-21T13:58:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.649669+0000", 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9450999999999997e-05 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126396 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.626478+0000", 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.019722050000000001, 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024491246000000001, 2024-09-21T13:58:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126396 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626478+0000", 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626478+0000", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626477+0000", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626480+0000", 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7080000000000002e-06 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626486+0000", 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.387e-06 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.626492+0000", 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7060000000000001e-06 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126539 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.627336+0000", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018864254, 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.023662778999999998, 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126539 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627336+0000", 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627336+0000", 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627335+0000", 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627338+0000", 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0479999999999999e-06 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627345+0000", 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7150000000000001e-06 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.627350+0000", 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3499999999999996e-06 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126675 3.18 3.9a7d8c58 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.628035+0000", 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018164604000000001, 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022990740999999999, 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126675 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628035+0000", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628035+0000", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628035+0000", 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628037+0000", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4830000000000002e-06 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628044+0000", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6869999999999997e-06 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.628049+0000", 2024-09-21T13:58:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5970000000000002e-06 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:127060 3.1e 3.60a891de (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.648908+0000", 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4294967295.997292, 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00214723, 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 127060 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648908+0000", 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648908+0000", 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648907+0000", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648914+0000", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7490000000000001e-06 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648921+0000", 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3679999999999996e-06 2024-09-21T13:58:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.648927+0000", 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8340000000000004e-06 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 102 2024-09-21T13:58:56.998 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:57.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:58:57.000 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-21T13:58:57.000 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:56.998+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:57.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --force --op remove --pgid 3.14 2024-09-21T13:58:57.101 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:57.099+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:57.156 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:57.156 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:58:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:58:57.157 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:58:57.157 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:57.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:58:57.188 INFO:teuthology.orchestra.run.smithi079.stdout:1689 trunc from 0xa9db41e to 0xa3a05c2 2024-09-21T13:58:57.201 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:57.198+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:57.219 INFO:teuthology.orchestra.run.smithi079.stdout:1691 write 0xb8b967 thru 0xb97bea (0xc284 bytes) 2024-09-21T13:58:57.260 INFO:teuthology.orchestra.run.smithi079.stdout:1692 writesame 0xdbfa872 thru 0xdc04a09 data_size 0x4(0xa198 bytes) 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.896882291000001, 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.298 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:58:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:58:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.856795453, 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.303 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:58:57.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:58:57.307 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.795482197, 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:58:57.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43373 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9273344~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:58:57.312 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.726489951, 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057399824000000002, 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43373 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:57.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571969+0000", 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571971+0000", 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.875e-06 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571977+0000", 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6869999999999999e-06 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571981+0000", 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3780000000000003e-06 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624831+0000", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052849396 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624906+0000", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5488999999999995e-05 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.629369+0000", 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044633140000000003 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102380 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9875456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.505328854, 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057339228999999999, 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102380 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.317 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793130+0000", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793133+0000", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793138+0000", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793143+0000", 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3590000000000001e-06 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.848975+0000", 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055832765999999999 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850324+0000", 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001348309 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850470+0000", 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146329 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102381 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9891840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5053131220000004, 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057520040000000001, 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102381 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793148+0000", 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793154+0000", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4110000000000004e-06 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793159+0000", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8599999999999998e-06 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850503+0000", 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057343425000000003 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850566+0000", 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3372000000000002e-05 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850666+0000", 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100212 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.325 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102393 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10088448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5014049350000001, 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055791436999999999, 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102393 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:57.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797054+0000", 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797057+0000", 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3829999999999999e-06 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797063+0000", 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4470000000000003e-06 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797068+0000", 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7219999999999999e-06 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852711+0000", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055643445999999999 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852754+0000", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2633000000000003e-05 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852846+0000", 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2275000000000007e-05 2024-09-21T13:58:57.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102394 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10104832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5013874810000001, 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055942143999999999, 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102394 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797074+0000", 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3889999999999999e-06 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797080+0000", 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6250000000000004e-06 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797084+0000", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852873+0000", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055788991000000003 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852953+0000", 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9758000000000004e-05 2024-09-21T13:58:57.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853014+0000", 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1320000000000002e-05 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102395 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10121216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.501371668, 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056134649000000002, 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102395 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797089+0000", 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9309999999999998e-06 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797095+0000", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5940000000000001e-06 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797099+0000", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2860000000000001e-06 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853039+0000", 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055939163 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853133+0000", 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4854999999999999e-05 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853223+0000", 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9145000000000001e-05 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102396 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10137600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.338 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5013563080000001, 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056318565000000001, 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102396 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797105+0000", 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2350000000000002e-06 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797111+0000", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797116+0000", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2939999999999999e-06 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853254+0000", 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056138331999999999 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853333+0000", 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9363999999999994e-05 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853422+0000", 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8350999999999995e-05 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102397 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10153984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5013400770000001, 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056598471999999997, 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102397 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797148+0000", 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8821000000000001e-05 2024-09-21T13:58:57.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797156+0000", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7049999999999999e-06 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797161+0000", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2079999999999999e-06 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853453+0000", 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056292498000000003 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853548+0000", 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4247999999999996e-05 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853718+0000", 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017028200000000001 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102398 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10170368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.346 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5012926140000005, 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056775582999999998, 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102398 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797166+0000", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797169+0000", 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4320000000000002e-06 2024-09-21T13:58:57.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797174+0000", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4659999999999998e-06 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797179+0000", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6589999999999998e-06 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853752+0000", 2024-09-21T13:58:57.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056573343999999998 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853849+0000", 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6674000000000003e-05 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853943+0000", 2024-09-21T13:58:57.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3474999999999995e-05 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102399 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10186752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5012271630000003, 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882133000000001, 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102399 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797235+0000", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5809999999999999e-06 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797239+0000", 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3579999999999996e-06 2024-09-21T13:58:57.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797244+0000", 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6979999999999997e-06 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853970+0000", 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056726625000000003 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854044+0000", 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3677999999999995e-05 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854115+0000", 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0605999999999995e-05 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102400 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10203136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5012116180000001, 2024-09-21T13:58:57.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057075064000000002, 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102400 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797250+0000", 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1550000000000001e-06 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797256+0000", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797260+0000", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5120000000000002e-06 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854142+0000", 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882017999999999 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854238+0000", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6197000000000001e-05 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854323+0000", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4507999999999998e-05 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102401 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10219520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:57.359 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5011936519999995, 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252537999999999, 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102401 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797268+0000", 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2989999999999999e-06 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797274+0000", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8039999999999998e-06 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797278+0000", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.544e-06 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854350+0000", 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057071380999999997 2024-09-21T13:58:57.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854430+0000", 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0665000000000001e-05 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854518+0000", 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8172999999999998e-05 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.363 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102402 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10235904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5011774520000003, 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057430862999999999, 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102402 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:57.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797284+0000", 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9690000000000001e-06 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797289+0000", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4310000000000002e-06 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797294+0000", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5539999999999999e-06 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854546+0000", 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252270000000001 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854610+0000", 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3577000000000005e-05 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854713+0000", 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103304 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.367 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102414 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10432512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4972634789999999, 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055926550999999998, 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102414 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:57.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801199+0000", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9409999999999999e-06 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801205+0000", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801210+0000", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9219999999999996e-06 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.856973+0000", 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055763004999999997 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857040+0000", 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7890000000000002e-05 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857123+0000", 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2206999999999994e-05 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102415 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10448896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.497245704, 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056684905000000001, 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102415 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.372 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:58:57.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801216+0000", 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801221+0000", 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5300000000000004e-06 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801226+0000", 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4989999999999996e-06 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857741+0000", 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056515507999999999 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857811+0000", 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0222999999999995e-05 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857899+0000", 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7390000000000002e-05 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102416 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10465280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4972300059999997, 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056878169999999999, 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102416 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801229+0000", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801232+0000", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5050000000000002e-06 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801239+0000", 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.985e-06 2024-09-21T13:58:57.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801244+0000", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7879999999999997e-06 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857939+0000", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056695027000000002 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858019+0000", 2024-09-21T13:58:57.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0493000000000003e-05 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858108+0000", 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8691999999999997e-05 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102417 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10481664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4972117169999999, 2024-09-21T13:58:57.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057035644000000003, 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102417 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801250+0000", 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3020000000000002e-06 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801255+0000", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6799999999999998e-06 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801260+0000", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5979999999999999e-06 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858134+0000", 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056874307999999998 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858202+0000", 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7126999999999996e-05 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858283+0000", 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1959999999999995e-05 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:58:57.384 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1694 punch from 0x32321f2 to 0x3238802, (0x6610 bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1695 read 0x388c563 thru 0x388fd06 (0x37a4 bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1696 punch from 0x2e63be1 to 0x2e6a1ff, (0x661e bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1697 punch from 0xd17ddae to 0xd181f73, (0x41c5 bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1699 read 0x4b98b0b thru 0x4b99802 (0xcf8 bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1700 read 0x2a33a9f thru 0x2a34478 (0x9da bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1703 read 0x34ac240 thru 0x34b1c9e (0x5a5f bytes) 2024-09-21T13:58:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:1705 writesame 0x7f05957 thru 0x7f0fd29 data_size 0x1(0xa3d3 bytes) 2024-09-21T13:58:57.387 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:58:57.388 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.388 INFO:teuthology.orchestra.run.smithi079.stdout:1708 read 0xc3558c thru 0xc359b4 (0x429 bytes) 2024-09-21T13:58:57.388 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.388 INFO:teuthology.orchestra.run.smithi079.stdout:1712 write 0xd37fbd9 thru 0xd38706d (0x7495 bytes) 2024-09-21T13:58:57.388 INFO:teuthology.orchestra.run.smithi079.stdout:1713 read 0xcd86c7d thru 0xcd8d26a (0x65ee bytes) 2024-09-21T13:58:57.388 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:57.382+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:57.397 INFO:teuthology.orchestra.run.smithi079.stdout:1714 trunc from 0xdc04a0a to 0x7d8ece6 2024-09-21T13:58:57.460 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.460 INFO:teuthology.orchestra.run.smithi079.stdout:1717 write 0x4d2f2bf thru 0x4d3d4ab (0xe1ed bytes) 2024-09-21T13:58:57.462 INFO:teuthology.orchestra.run.smithi079.stdout:1719 read 0x23ab91a thru 0x23b8766 (0xce4d bytes) 2024-09-21T13:58:57.487 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:57.487+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:57.487 INFO:teuthology.orchestra.run.smithi079.stdout:1721 writesame 0xd167ef6 thru 0xd16aa25 data_size 0x8(0x2b30 bytes) 2024-09-21T13:58:57.489 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.489 INFO:teuthology.orchestra.run.smithi079.stdout:1724 writesame 0xcaf2810 thru 0xcafb6c9 data_size 0x1(0x8eba bytes) 2024-09-21T13:58:57.507 INFO:teuthology.orchestra.run.smithi079.stdout:1727 trunc from 0xd16aa26 to 0xdf979bc 2024-09-21T13:58:57.518 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.518 INFO:teuthology.orchestra.run.smithi079.stdout:1731 writesame 0x20b8a2a thru 0x20c718c data_size 0x21(0xe763 bytes) 2024-09-21T13:58:57.520 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:131039 3.6 e50/39 3:61209146:::rbd_data.11857a54fb10.0000000000000008:head v 50'105, mlcod=50'103)", 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:57.521878+0000", 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00081511099999999998, 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00085180599999999998, 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.521878+0000", 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.521878+0000", 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.521877+0000", 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.521990+0000", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011336300000000001 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.522004+0000", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3648e-05 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.522013+0000", 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0999999999999993e-06 2024-09-21T13:58:57.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.522076+0000", 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3674000000000001e-05 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:57.522097+0000", 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0723000000000001e-05 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.524 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T13:58:57.525 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-09-21T13:58:57.525 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:57.525 INFO:teuthology.orchestra.run.smithi079.stdout:1732 writesame 0x7478ce9 thru 0x74803fd data_size 0x43(0x7715 bytes) 2024-09-21T13:58:57.526 INFO:teuthology.orchestra.run.smithi079.stdout:1733 punch from 0x202850f to 0x203326d, (0xad5e bytes) 2024-09-21T13:58:57.526 INFO:teuthology.orchestra.run.smithi079.stdout:1734 write 0xd47c64d thru 0xd482aa2 (0x6456 bytes) 2024-09-21T13:58:57.528 INFO:teuthology.orchestra.run.smithi079.stdout:1735 read 0x7d5f005 thru 0x7d6d4e8 (0xe4e4 bytes) 2024-09-21T13:58:57.529 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.529 INFO:teuthology.orchestra.run.smithi079.stdout:1738 write 0xcf52662 thru 0xcf54884 (0x2223 bytes) 2024-09-21T13:58:57.531 INFO:teuthology.orchestra.run.smithi079.stdout:1742 write 0x8a4fdcd thru 0x8a5b273 (0xb4a7 bytes) 2024-09-21T13:58:57.534 INFO:teuthology.orchestra.run.smithi079.stdout:1744 read 0x467fb10 thru 0x4686612 (0x6b03 bytes) 2024-09-21T13:58:57.535 INFO:teuthology.orchestra.run.smithi079.stdout:1745 writesame 0x9a8778a thru 0x9a93a0b data_size 0x6(0xc282 bytes) 2024-09-21T13:58:57.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:58:57.547 INFO:teuthology.orchestra.run.smithi079.stdout:1746 read 0x3f6878b thru 0x3f7556f (0xcde5 bytes) 2024-09-21T13:58:57.548 INFO:teuthology.orchestra.run.smithi079.stdout:1748 read 0xd78fd03 thru 0xd79f1a2 (0xf4a0 bytes) 2024-09-21T13:58:57.548 INFO:teuthology.orchestra.run.smithi079.stdout:1750 write 0x4be2965 thru 0x4bee83e (0xbeda bytes) 2024-09-21T13:58:57.551 INFO:teuthology.orchestra.run.smithi079.stdout:1751 write 0xbcab1a1 thru 0xbcb4fc3 (0x9e23 bytes) 2024-09-21T13:58:57.554 INFO:teuthology.orchestra.run.smithi079.stdout:1752 read 0xb4cb91e thru 0xb4d801e (0xc701 bytes) 2024-09-21T13:58:57.555 INFO:teuthology.orchestra.run.smithi079.stdout:1753 read 0x3d30cd9 thru 0x3d3cb1e (0xbe46 bytes) 2024-09-21T13:58:57.556 INFO:teuthology.orchestra.run.smithi079.stdout:1754 read 0x920ff59 thru 0x9216648 (0x66f0 bytes) 2024-09-21T13:58:57.556 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.556 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:57.573 INFO:teuthology.orchestra.run.smithi079.stdout:1758 trunc from 0xdf979bc to 0x70784c7 2024-09-21T13:58:57.587 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:57.586+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:57.588 INFO:teuthology.orchestra.run.smithi079.stdout:1759 writesame 0x12e7147 thru 0x12f4e09 data_size 0x59(0xdcc3 bytes) 2024-09-21T13:58:57.611 INFO:teuthology.orchestra.run.smithi079.stdout:1760 writesame 0xb8984a8 thru 0xb89c787 data_size 0x14(0x42e0 bytes) 2024-09-21T13:58:57.612 INFO:teuthology.orchestra.run.smithi079.stdout:1763 punch from 0x764f779 to 0x7653e70, (0x46f7 bytes) 2024-09-21T13:58:57.612 INFO:teuthology.orchestra.run.smithi079.stdout:1764 clone 12 order 20 su 262144 sc 9 2024-09-21T13:58:57.688 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:57.687+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:57.696 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:57.697 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:57.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:58:57.789 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:57.786+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:57.875 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:58:57.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063619473999999, 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:58:57.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063549815, 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:58:57.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:58:57.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063447239, 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063316970000001, 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:58:57.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:58:57.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:58:57.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063249781, 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:58:57.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:58:57.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.063143815, 2024-09-21T13:58:57.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:58:57.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062989306, 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.06293473, 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:57.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062835314000001, 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:58:57.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062691188000001, 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:58:57.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062627858999999, 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:58:57.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:58:57.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062528332999999, 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:58:57.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062384714, 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:58:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:58:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062340251, 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:58:57.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062226172000001, 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.062090873000001, 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:58:57.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:57.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061784935, 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:58:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061454834999999, 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:57.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061166393000001, 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.060912275, 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:58:57.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:58:57.961 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:57.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:58:57.963 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:57.962+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:58.063 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:58.063+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:58.088 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:58.088 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:58:58.089 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:58.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:58:58.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:58:58.191 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:58.190+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:58.265 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:58.262+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:58.266 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:58:58.266 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:58:58.267 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:58:58.267 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:58:58.267 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:58:58.281 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:58:58.298 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:58:58.298 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:58:58.315 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:58:58.315 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:58:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: marking collection for removal 2024-09-21T13:58:58.322 INFO:teuthology.orchestra.run.smithi134.stdout:setting '_remove' omap key 2024-09-21T13:58:58.326 INFO:teuthology.orchestra.run.smithi134.stdout:finish_remove_pgs 3.14_head removing 3.14 2024-09-21T13:58:58.330 INFO:teuthology.orchestra.run.smithi134.stdout:Remove successful 2024-09-21T13:58:58.331 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:58:58.331 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:58:58.345 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:58:58.345 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:58:58.364 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:58:58.364 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:58:58.365 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:58.363+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:58.388 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:58:58.389 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:58:58.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:58:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:58:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:58:58.412 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:58.412 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:58.415 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:58:58.416 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:58:58.428 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:58:58.428 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:58:58.466 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone11 from 0xb89c788 (overlap 0x70784c7) to 0x0 2024-09-21T13:58:58.467 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:58.466+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:58.568 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:58.567+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:58.574 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-21T13:58:58.583 INFO:teuthology.orchestra.run.smithi079.stdout:1765 trunc from 0xb89c788 to 0x772e5f5 2024-09-21T13:58:58.601 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:58.601 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:58.614 INFO:teuthology.orchestra.run.smithi079.stdout:1766 write 0x854f85b thru 0x8552ff2 (0x3798 bytes) 2024-09-21T13:58:58.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:58:58.617 INFO:teuthology.orchestra.run.smithi079.stdout:1768 punch from 0x38f8a28 to 0x3906994, (0xdf6c bytes) 2024-09-21T13:58:58.617 INFO:teuthology.orchestra.run.smithi079.stdout:1769 read 0x5773554 thru 0x5773abe (0x56b bytes) 2024-09-21T13:58:58.618 INFO:teuthology.orchestra.run.smithi079.stdout:1770 read 0x7fcddfb thru 0x7fcf648 (0x184e bytes) 2024-09-21T13:58:58.618 INFO:teuthology.orchestra.run.smithi079.stdout:1771 punch from 0x105f2c0 to 0x1064ab8, (0x57f8 bytes) 2024-09-21T13:58:58.621 INFO:teuthology.orchestra.run.smithi079.stdout:1773 trunc from 0x8552ff3 to 0x5e18e74 2024-09-21T13:58:58.644 INFO:teuthology.orchestra.run.smithi079.stdout:1775 read 0x236de1d thru 0x23712a9 (0x348d bytes) 2024-09-21T13:58:58.656 INFO:teuthology.orchestra.run.smithi079.stdout:1776 writesame 0x99fcac3 thru 0x9a07d0c data_size 0x3(0xb24a bytes) 2024-09-21T13:58:58.667 INFO:teuthology.orchestra.run.smithi079.stdout:1778 write 0xc552159 thru 0xc55c084 (0x9f2c bytes) 2024-09-21T13:58:58.670 INFO:teuthology.orchestra.run.smithi079.stdout:1780 read 0x97b29b5 thru 0x97b775d (0x4da9 bytes) 2024-09-21T13:58:58.673 INFO:teuthology.orchestra.run.smithi079.stdout:1782 trunc from 0xc55c085 to 0xaa74a29 2024-09-21T13:58:58.684 INFO:teuthology.orchestra.run.smithi079.stdout:1783 write 0x12839ce thru 0x129393b (0xff6e bytes) 2024-09-21T13:58:58.690 INFO:teuthology.orchestra.run.smithi079.stdout:1784 punch from 0x7ef6bec to 0x7efde3f, (0x7253 bytes) 2024-09-21T13:58:58.690 INFO:teuthology.orchestra.run.smithi079.stdout:1785 read 0x63f8507 thru 0x63f97f5 (0x12ef bytes) 2024-09-21T13:58:58.701 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:58.703+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:58.703 INFO:teuthology.orchestra.run.smithi079.stdout:1786 writesame 0xe0d890b thru 0xe0e072c data_size 0x5(0x7e22 bytes) 2024-09-21T13:58:58.720 INFO:teuthology.orchestra.run.smithi079.stdout:1788 trunc from 0xe0e072d to 0x2d3138b 2024-09-21T13:58:58.765 INFO:teuthology.orchestra.run.smithi079.stdout:1789 write 0xb264abf thru 0xb2660b0 (0x15f2 bytes) 2024-09-21T13:58:58.769 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:58.766+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:58.772 INFO:teuthology.orchestra.run.smithi079.stdout:1790 writesame 0x70a5c67 thru 0x70b0488 data_size 0x1(0xa822 bytes) 2024-09-21T13:58:58.780 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:58.780 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:58.801 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:58:58.811 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:58.811 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:58.811 INFO:teuthology.orchestra.run.smithi079.stdout:1793 write 0x67447d4 thru 0x674f5e6 (0xae13 bytes) 2024-09-21T13:58:58.815 INFO:teuthology.orchestra.run.smithi079.stdout:1794 read 0x7afbb7d thru 0x7b06afd (0xaf81 bytes) 2024-09-21T13:58:58.815 INFO:teuthology.orchestra.run.smithi079.stdout:1796 punch from 0x49c2d9d to 0x49ca517, (0x777a bytes) 2024-09-21T13:58:58.828 INFO:teuthology.orchestra.run.smithi079.stdout:1797 write 0xe08917b thru 0xe097147 (0xdfcd bytes) 2024-09-21T13:58:58.833 INFO:teuthology.orchestra.run.smithi079.stdout:1798 punch from 0x3a876f1 to 0x3a8b5b0, (0x3ebf bytes) 2024-09-21T13:58:58.833 INFO:teuthology.orchestra.run.smithi079.stdout:1799 read 0x684cd54 thru 0x6855374 (0x8621 bytes) 2024-09-21T13:58:58.852 INFO:teuthology.orchestra.run.smithi079.stdout:1800 trunc from 0xe097148 to 0xa7859c 2024-09-21T13:58:58.870 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:58.866+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:58.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.14.7 2024-09-21T13:58:58.888 INFO:teuthology.orchestra.run.smithi079.stdout:1801 punch from 0x8478c2 to 0x847dd3, (0x511 bytes) 2024-09-21T13:58:58.914 INFO:teuthology.orchestra.run.smithi079.stdout:1802 writesame 0x8d1e35f thru 0x8d2de0d data_size 0x19(0xfaaf bytes) 2024-09-21T13:58:58.914 INFO:teuthology.orchestra.run.smithi079.stdout:1804 punch from 0x5fefd91 to 0x5ffaa3a, (0xaca9 bytes) 2024-09-21T13:58:58.914 INFO:teuthology.orchestra.run.smithi079.stdout:1805 read 0x47a11dc thru 0x47a8a37 (0x785c bytes) 2024-09-21T13:58:58.935 INFO:teuthology.orchestra.run.smithi079.stdout:1807 writesame 0xe6611c2 thru 0xe664644 data_size 0x1(0x3483 bytes) 2024-09-21T13:58:58.938 INFO:teuthology.orchestra.run.smithi079.stdout:1809 trunc from 0xe664645 to 0xd3bf310 2024-09-21T13:58:58.948 INFO:teuthology.orchestra.run.smithi079.stdout:1810 punch from 0x8e5328a to 0x8e56089, (0x2dff bytes) 2024-09-21T13:58:58.948 INFO:teuthology.orchestra.run.smithi079.stdout:1813 write 0x5f65523 thru 0x5f6f9b1 (0xa48f bytes) 2024-09-21T13:58:58.953 INFO:teuthology.orchestra.run.smithi079.stdout:1814 write 0xa8ba1ae thru 0xa8bf53c (0x538f bytes) 2024-09-21T13:58:58.957 INFO:teuthology.orchestra.run.smithi079.stdout:1815 write 0x910fcdf thru 0x911c269 (0xc58b bytes) 2024-09-21T13:58:58.962 INFO:teuthology.orchestra.run.smithi079.stdout:1816 write 0xb4666dc thru 0xb46abc1 (0x44e6 bytes) 2024-09-21T13:58:58.967 INFO:teuthology.orchestra.run.smithi079.stdout:1817 punch from 0x563dedd to 0x563eb38, (0xc5b bytes) 2024-09-21T13:58:58.973 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:58:58.975+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:58:58.974 INFO:teuthology.orchestra.run.smithi079.stdout:1818 trunc from 0xd3bf310 to 0xaae39e2 2024-09-21T13:58:58.978 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:58.979 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:58.992 INFO:teuthology.orchestra.run.smithi079.stdout:1819 punch from 0x88a3830 to 0x88aa4af, (0x6c7f bytes) 2024-09-21T13:58:58.996 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:58:59.004 INFO:teuthology.orchestra.run.smithi079.stdout:1820 write 0xba45f54 thru 0xba4ffc7 (0xa074 bytes) 2024-09-21T13:58:59.008 INFO:teuthology.orchestra.run.smithi079.stdout:1821 punch from 0x4337c79 to 0x4339543, (0x18ca bytes) 2024-09-21T13:58:59.008 INFO:teuthology.orchestra.run.smithi079.stdout:1822 read 0x31c8e4e thru 0x31d5310 (0xc4c3 bytes) 2024-09-21T13:58:59.008 INFO:teuthology.orchestra.run.smithi079.stdout:1823 write 0x8e11088 thru 0x8e1ea09 (0xd982 bytes) 2024-09-21T13:58:59.012 INFO:teuthology.orchestra.run.smithi079.stdout:1825 read 0x106465c thru 0x10700c6 (0xba6b bytes) 2024-09-21T13:58:59.013 INFO:teuthology.orchestra.run.smithi079.stdout:1826 write 0x7172b9d thru 0x7176f66 (0x43ca bytes) 2024-09-21T13:58:59.018 INFO:teuthology.orchestra.run.smithi079.stdout:1827 read 0x6ac4f18 thru 0x6ad0490 (0xb579 bytes) 2024-09-21T13:58:59.022 INFO:teuthology.orchestra.run.smithi079.stdout:1828 trunc from 0xba4ffc8 to 0xd7a6357 2024-09-21T13:58:59.029 INFO:teuthology.orchestra.run.smithi079.stdout:1829 writesame 0x132c918 thru 0x1330da0 data_size 0x37(0x4489 bytes) 2024-09-21T13:58:59.033 INFO:teuthology.orchestra.run.smithi079.stdout:1830 write 0xd3368d9 thru 0xd33fcd9 (0x9401 bytes) 2024-09-21T13:58:59.038 INFO:teuthology.orchestra.run.smithi079.stdout:1831 punch from 0x1cb4655 to 0x1cb760d, (0x2fb8 bytes) 2024-09-21T13:58:59.038 INFO:teuthology.orchestra.run.smithi079.stdout:1834 punch from 0x1265078 to 0x126f331, (0xa2b9 bytes) 2024-09-21T13:58:59.038 INFO:teuthology.orchestra.run.smithi079.stdout:1835 writesame 0x926094a thru 0x9264505 data_size 0x2(0x3bbc bytes) 2024-09-21T13:58:59.044 INFO:teuthology.orchestra.run.smithi079.stdout:1837 writesame 0x620d9f4 thru 0x6219dc4 data_size 0x1(0xc3d1 bytes) 2024-09-21T13:58:59.071 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:59.070+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:59.085 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.096 INFO:teuthology.orchestra.run.smithi079.stdout:1841 trunc from 0xd7a6357 to 0x6a4d2e0 2024-09-21T13:58:59.139 INFO:teuthology.orchestra.run.smithi079.stdout:1842 writesame 0xd749ff6 thru 0xd74f6f0 data_size 0x1(0x56fb bytes) 2024-09-21T13:58:59.148 INFO:teuthology.orchestra.run.smithi079.stdout:1843 trunc from 0xd74f6f1 to 0x7ee2766 2024-09-21T13:58:59.148 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.148 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.160 INFO:teuthology.orchestra.run.smithi079.stdout:1844 write 0x5c3e11d thru 0x5c4c27e (0xe162 bytes) 2024-09-21T13:58:59.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:58:59.167 INFO:teuthology.orchestra.run.smithi079.stdout:1845 write 0x76a3810 thru 0x76a9686 (0x5e77 bytes) 2024-09-21T13:58:59.171 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:58:59.171+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:58:59.172 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.172 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.172 INFO:teuthology.orchestra.run.smithi079.stdout:1849 write 0x70e9ae0 thru 0x70ed48c (0x39ad bytes) 2024-09-21T13:58:59.183 INFO:teuthology.orchestra.run.smithi079.stdout:1850 trunc from 0x7ee2766 to 0xba92847 2024-09-21T13:58:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:1851 punch from 0x2432443 to 0x2435ab1, (0x366e bytes) 2024-09-21T13:58:59.189 INFO:teuthology.orchestra.run.smithi079.stdout:1852 write 0xda41db thru 0xda61dd (0x2003 bytes) 2024-09-21T13:58:59.191 INFO:teuthology.orchestra.run.smithi079.stdout:1853 read 0xaaed71c thru 0xaafc5e0 (0xeec5 bytes) 2024-09-21T13:58:59.191 INFO:teuthology.orchestra.run.smithi079.stdout:1854 read 0x49d372b thru 0x49deb2b (0xb401 bytes) 2024-09-21T13:58:59.191 INFO:teuthology.orchestra.run.smithi079.stdout:1855 writesame 0x496fa7 thru 0x499bd8 data_size 0x1(0x2c32 bytes) 2024-09-21T13:58:59.229 INFO:teuthology.orchestra.run.smithi079.stdout:1857 trunc from 0xba92847 to 0x757c903 2024-09-21T13:58:59.266 INFO:teuthology.orchestra.run.smithi079.stdout:1858 write 0xede2381 thru 0xedf0b9b (0xe81b bytes) 2024-09-21T13:58:59.272 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:59.270+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:59.274 INFO:teuthology.orchestra.run.smithi079.stdout:1860 writesame 0x156ae72 thru 0x156db3a data_size 0x1(0x2cc9 bytes) 2024-09-21T13:58:59.282 INFO:teuthology.orchestra.run.smithi079.stdout:1861 write 0x7fd210d thru 0x7fdfb5d (0xda51 bytes) 2024-09-21T13:58:59.286 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.286 INFO:teuthology.orchestra.run.smithi079.stdout:1865 write 0x88c27ab thru 0x88d13a8 (0xebfe bytes) 2024-09-21T13:58:59.291 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.291 INFO:teuthology.orchestra.run.smithi079.stdout:1868 punch from 0x44f4cc8 to 0x44ff89c, (0xabd4 bytes) 2024-09-21T13:58:59.291 INFO:teuthology.orchestra.run.smithi079.stdout:1869 read 0x414fcc1 thru 0x415af76 (0xb2b6 bytes) 2024-09-21T13:58:59.291 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.291 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.292 INFO:teuthology.orchestra.run.smithi079.stdout:1870 writesame 0xc321b9c thru 0xc32e4b2 data_size 0x1(0xc917 bytes) 2024-09-21T13:58:59.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:58:59.331 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.334 INFO:teuthology.orchestra.run.smithi079.stdout:1872 trunc from 0xedf0b9c to 0xca370b5 2024-09-21T13:58:59.347 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:58:59.347 INFO:teuthology.orchestra.run.smithi079.stdout:1876 write 0xc66d6c2 thru 0xc67ad10 (0xd64f bytes) 2024-09-21T13:58:59.353 INFO:teuthology.orchestra.run.smithi079.stdout:1877 write 0x50d26c thru 0x5148d6 (0x766b bytes) 2024-09-21T13:58:59.366 INFO:teuthology.orchestra.run.smithi079.stdout:1878 read 0x7ce842f thru 0x7cf049e (0x8070 bytes) 2024-09-21T13:58:59.366 INFO:teuthology.orchestra.run.smithi079.stdout:1879 write 0x2b797a2 thru 0x2b86cf4 (0xd553 bytes) 2024-09-21T13:58:59.371 INFO:teuthology.orchestra.run.smithi079.stdout:1880 writesame 0x9b7386c thru 0x9b7d501 data_size 0x33(0x9c96 bytes) 2024-09-21T13:58:59.372 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:58:59.370+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:58:59.376 INFO:teuthology.orchestra.run.smithi079.stdout:1881 read 0x6748c55 thru 0x67526eb (0x9a97 bytes) 2024-09-21T13:58:59.382 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:58:59.390 INFO:teuthology.orchestra.run.smithi079.stdout:1882 write 0xd337d5f thru 0xd346d55 (0xeff7 bytes) 2024-09-21T13:58:59.398 INFO:teuthology.orchestra.run.smithi079.stdout:1884 trunc from 0xd346d56 to 0xdcd0d33 2024-09-21T13:58:59.405 INFO:teuthology.orchestra.run.smithi079.stdout:1885 read 0xac7b09e thru 0xac8a889 (0xf7ec bytes) 2024-09-21T13:58:59.405 INFO:teuthology.orchestra.run.smithi079.stdout:1886 read 0x73a2906 thru 0x73adf3c (0xb637 bytes) 2024-09-21T13:58:59.405 INFO:teuthology.orchestra.run.smithi079.stdout:1888 write 0x9bc65ea thru 0x9bd32d8 (0xccef bytes) 2024-09-21T13:58:59.410 INFO:teuthology.orchestra.run.smithi079.stdout:1889 write 0x77b3f33 thru 0x77be5ab (0xa679 bytes) 2024-09-21T13:58:59.415 INFO:teuthology.orchestra.run.smithi079.stdout:1891 clone 13 order 19 su 32768 sc 8 2024-09-21T13:58:59.461 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.461 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.473 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:58:59.470+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:58:59.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:58:59.574 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:59.574+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:59.641 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.642 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:58:59.703 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:58:59.702+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:58:59.775 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:59.775+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:59.828 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.828 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:58:59.877 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:58:59.875+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:58:59.966 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:58:59.966 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:58:59.977 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:58:59.974+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:58:59.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-21T13:59:00.078 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:00.079+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:00.104 INFO:teuthology.orchestra.run.smithi134.stdout:get_pg_num_history pg_num_history pg_num_history(e43 pg_nums {1={15=1},2={18=8},3={23=32}} deleted_pools ) 2024-09-21T13:59:00.104 INFO:teuthology.orchestra.run.smithi134.stdout:Importing pgid 3.14 2024-09-21T13:59:00.105 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:28e320bf:::rbd_data.11854cc47015.000000000000004c:head# 2024-09-21T13:59:00.105 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 0=[]:{} 2024-09-21T13:59:00.105 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:29f1eac1:::rbd_data.11855cdad4c2.000000000000003c:head# 2024-09-21T13:59:00.105 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 6=[]:{} 2024-09-21T13:59:00.105 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:5# 2024-09-21T13:59:00.108 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2aa31453:::rbd_data.1185e8851f1.000000000000000a:head# 2024-09-21T13:59:00.109 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 5=[]:{5=[5]} 2024-09-21T13:59:00.111 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2bb4acb3:::rbd_id.image_client.0-clone5:head# 2024-09-21T13:59:00.112 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 0=[]:{} 2024-09-21T13:59:00.114 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2c5a2e4a:::rbd_data.1185bf1a1adb.0000000000000001:9# 2024-09-21T13:59:00.118 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2c5a2e4a:::rbd_data.1185bf1a1adb.0000000000000001:head# 2024-09-21T13:59:00.119 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 9=[]:{9=[9]} 2024-09-21T13:59:00.122 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2cd33b39:::rbd_object_map.11853c86949e:head# 2024-09-21T13:59:00.122 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 0=[]:{} 2024-09-21T13:59:00.122 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2d005fad:::rbd_data.1185bf1a1adb.0000000000000007:9# 2024-09-21T13:59:00.125 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2d005fad:::rbd_data.1185bf1a1adb.0000000000000007:head# 2024-09-21T13:59:00.125 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 9=[]:{9=[9]} 2024-09-21T13:59:00.127 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2d2f3d79:::rbd_data.11855cdad4c2.0000000000000040:head# 2024-09-21T13:59:00.127 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 6=[]:{} 2024-09-21T13:59:00.127 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2d6a3740:::rbd_data.1185a7c518d0.0000000000000183:head# 2024-09-21T13:59:00.127 INFO:teuthology.orchestra.run.smithi134.stdout:snapset b=[]:{} 2024-09-21T13:59:00.128 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2d86fb72:::rbd_data.1185a7c518d0.000000000000019b:head# 2024-09-21T13:59:00.128 INFO:teuthology.orchestra.run.smithi134.stdout:snapset b=[]:{} 2024-09-21T13:59:00.128 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2ec6815d:::rbd_data.1185e0e4cd61.000000000000000a:8# 2024-09-21T13:59:00.134 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2ec6815d:::rbd_data.1185e0e4cd61.000000000000000a:head# 2024-09-21T13:59:00.135 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 8=[]:{8=[8]} 2024-09-21T13:59:00.137 INFO:teuthology.orchestra.run.smithi134.stdout:Write #3:2eccc5cc:::rbd_data.1185a7c518d0.0000000000000116:head# 2024-09-21T13:59:00.137 INFO:teuthology.orchestra.run.smithi134.stdout:snapset 0=[]:{} 2024-09-21T13:59:00.138 INFO:teuthology.orchestra.run.smithi134.stdout:write_pg epoch 41 info 3.14( v 41'131 (0'0,41'131] local-lis/les=23/24 n=16 ec=23/23 lis/c=23/23 les/c/f=24/24/0 sis=23) 2024-09-21T13:59:00.140 INFO:teuthology.orchestra.run.smithi134.stdout:Import successful 2024-09-21T13:59:00.143 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:00.143 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:00.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:00.203 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:00.202+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:00.279 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:00.278+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:00.280 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:00.280 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:00.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:00.383 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:00.382+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:00.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:00.468 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:00.469 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:00.481 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:00.478+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:00.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:00.512 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone12 from 0xdcd0d33 (overlap 0xa7859c) to 0x0 2024-09-21T13:59:00.582 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:00.582+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:00.582 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:00.583 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:00.601 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:00.602 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:00.630 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:00.631 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:00.632 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:00.632 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:00.637 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-21T13:59:00.640 INFO:teuthology.orchestra.run.smithi079.stdout:1892 writesame 0x902bb88 thru 0x9030adc data_size 0x1(0x4f55 bytes) 2024-09-21T13:59:00.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:00.656 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:00.656 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:00.659 INFO:teuthology.orchestra.run.smithi079.stdout:1893 write 0xa26c6d thru 0xa2d427 (0x67bb bytes) 2024-09-21T13:59:00.672 INFO:teuthology.orchestra.run.smithi079.stdout:1894 read 0x79351fc thru 0x7936e24 (0x1c29 bytes) 2024-09-21T13:59:00.678 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:00.678 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:00.684 INFO:teuthology.orchestra.run.smithi079.stdout:1896 trunc from 0xdcd0d33 to 0x65a4e97 2024-09-21T13:59:00.696 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:00.696 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:00.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /var/log/ceph/exp.3.14.7 2024-09-21T13:59:00.713 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:00.717 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:00.717 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:00.733 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:00.682+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1897 read 0x2a9b4c0 thru 0x2aa5d14 (0xa855 bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1899 punch from 0x4eec381 to 0x4eecc70, (0x8ef bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1900 punch from 0x3f2e2c4 to 0x3f38717, (0xa453 bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1901 read 0x44ec89b thru 0x44ef380 (0x2ae6 bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1902 punch from 0x43678f0 to 0x436fc7c, (0x838c bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1903 read 0x3b24dc3 thru 0x3b2d7a8 (0x89e6 bytes) 2024-09-21T13:59:00.750 INFO:teuthology.orchestra.run.smithi079.stdout:1905 write 0x16be004 thru 0x16c1f6b (0x3f68 bytes) 2024-09-21T13:59:00.756 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.756 INFO:teuthology.orchestra.run.smithi079.stdout:1910 write 0x175c199 thru 0x175d81c (0x1684 bytes) 2024-09-21T13:59:00.761 INFO:teuthology.orchestra.run.smithi079.stdout:1911 write 0x45f0958 thru 0x45f93c4 (0x8a6d bytes) 2024-09-21T13:59:00.768 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.768 INFO:teuthology.orchestra.run.smithi079.stdout:1913 writesame 0x3e5c8e4 thru 0x3e6a9ec data_size 0x6f(0xe109 bytes) 2024-09-21T13:59:00.784 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:00.782+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:00.785 INFO:teuthology.orchestra.run.smithi079.stdout:1915 trunc from 0x65a4e97 to 0xcc358ed 2024-09-21T13:59:00.790 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:00.790 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:00.790 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:00.790 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:00.790 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:00.812 INFO:teuthology.orchestra.run.smithi079.stdout:1917 trunc from 0xcc358ed to 0x1364504 2024-09-21T13:59:00.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:00.846 INFO:teuthology.orchestra.run.smithi079.stdout:1918 read 0x6a36c9 thru 0x6aea0e (0xb346 bytes) 2024-09-21T13:59:00.846 INFO:teuthology.orchestra.run.smithi079.stdout:1920 read 0xdd4250 thru 0xddecae (0xaa5f bytes) 2024-09-21T13:59:00.848 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.848 INFO:teuthology.orchestra.run.smithi079.stdout:1922 punch from 0x552019 to 0x558522, (0x6509 bytes) 2024-09-21T13:59:00.848 INFO:teuthology.orchestra.run.smithi079.stdout:1924 read 0x11a9ae8 thru 0x11b0886 (0x6d9f bytes) 2024-09-21T13:59:00.848 INFO:teuthology.orchestra.run.smithi079.stdout:1927 read 0xed9e59 thru 0xee9491 (0xf639 bytes) 2024-09-21T13:59:00.849 INFO:teuthology.orchestra.run.smithi079.stdout:1928 read 0xee2941 thru 0xeec8c6 (0x9f86 bytes) 2024-09-21T13:59:00.859 INFO:teuthology.orchestra.run.smithi079.stdout:1930 write 0x37275ac thru 0x3729abd (0x2512 bytes) 2024-09-21T13:59:00.867 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.867 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.867 INFO:teuthology.orchestra.run.smithi079.stdout:1933 write 0x8bc5f2 thru 0x8c0090 (0x3a9f bytes) 2024-09-21T13:59:00.874 INFO:teuthology.orchestra.run.smithi079.stdout:1934 write 0x411458 thru 0x41acf3 (0x989c bytes) 2024-09-21T13:59:00.884 INFO:teuthology.orchestra.run.smithi079.stdout:1935 read 0x236d4a6 thru 0x23798f5 (0xc450 bytes) 2024-09-21T13:59:00.884 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.885 INFO:teuthology.orchestra.run.smithi079.stdout:1937 read 0x18a021a thru 0x18a8f42 (0x8d29 bytes) 2024-09-21T13:59:00.885 INFO:teuthology.orchestra.run.smithi079.stdout:1938 punch from 0x2fe7af1 to 0x2fed629, (0x5b38 bytes) 2024-09-21T13:59:00.885 INFO:teuthology.orchestra.run.smithi079.stdout:1939 read 0x155bbb9 thru 0x1565b1b (0x9f63 bytes) 2024-09-21T13:59:00.885 INFO:teuthology.orchestra.run.smithi079.stdout:1940 read 0x204643e thru 0x204a798 (0x435b bytes) 2024-09-21T13:59:00.885 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:00.882+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:00.902 INFO:teuthology.orchestra.run.smithi079.stdout:1943 writesame 0x981d39d thru 0x981d4e4 data_size 0x8(0x148 bytes) 2024-09-21T13:59:00.902 INFO:teuthology.orchestra.run.smithi079.stdout:1946 write 0x4736718 thru 0x47458cf (0xf1b8 bytes) 2024-09-21T13:59:00.910 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.910 INFO:teuthology.orchestra.run.smithi079.stdout:1950 write 0x28182b5 thru 0x2818322 (0x6e bytes) 2024-09-21T13:59:00.913 INFO:teuthology.orchestra.run.smithi079.stdout:1951 read 0x28c125b thru 0x28c3ea5 (0x2c4b bytes) 2024-09-21T13:59:00.913 INFO:teuthology.orchestra.run.smithi079.stdout:1952 write 0x8f3e403 thru 0x8f48397 (0x9f95 bytes) 2024-09-21T13:59:00.923 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.941 INFO:teuthology.orchestra.run.smithi079.stdout:1956 write 0xeb3e7af thru 0xeb47876 (0x90c8 bytes) 2024-09-21T13:59:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.947 INFO:teuthology.orchestra.run.smithi079.stdout:1960 write 0xa407cc6 thru 0xa411ace (0x9e09 bytes) 2024-09-21T13:59:00.957 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.958 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:00.958 INFO:teuthology.orchestra.run.smithi079.stdout:1964 write 0x4f3349d thru 0x4f418c2 (0xe426 bytes) 2024-09-21T13:59:00.966 INFO:teuthology.orchestra.run.smithi079.stdout:1965 clone 14 order 18 su 1024 sc 5 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:00.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.582400847999999, 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:00.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:00.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:00.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.542314009999998, 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:00.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:00.993 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.481000754, 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:00.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:00.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:00.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:43373 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9273344~2048] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.412008508, 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057399824000000002, 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 43373 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:00.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571970+0000", 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571969+0000", 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571971+0000", 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.875e-06 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571977+0000", 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6869999999999999e-06 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.571981+0000", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3780000000000003e-06 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624831+0000", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052849396 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.624906+0000", 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5488999999999995e-05 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:46.629369+0000", 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044633140000000003 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102380 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9875456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.190847411, 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057339228999999999, 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102380 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793131+0000", 2024-09-21T13:59:01.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793130+0000", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793133+0000", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793138+0000", 2024-09-21T13:59:01.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793143+0000", 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3590000000000001e-06 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.848975+0000", 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055832765999999999 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850324+0000", 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001348309 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850470+0000", 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146329 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102381 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 9891840~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1908316790000004, 2024-09-21T13:59:01.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057520040000000001, 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102381 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793146+0000", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793148+0000", 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-21T13:59:01.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793154+0000", 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4110000000000004e-06 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.793159+0000", 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8599999999999998e-06 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850503+0000", 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057343425000000003 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850566+0000", 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3372000000000002e-05 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.850666+0000", 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100212 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102393 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10088448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.012 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.186923492, 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055791436999999999, 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102393 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:59:01.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797055+0000", 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797054+0000", 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797057+0000", 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3829999999999999e-06 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797063+0000", 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4470000000000003e-06 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797068+0000", 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7219999999999999e-06 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852711+0000", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055643445999999999 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852754+0000", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2633000000000003e-05 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852846+0000", 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2275000000000007e-05 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.016 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102394 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10104832~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1869060380000001, 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055942143999999999, 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.017 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102394 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797072+0000", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797074+0000", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3889999999999999e-06 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797080+0000", 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6250000000000004e-06 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797084+0000", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852873+0000", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055788991000000003 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.852953+0000", 2024-09-21T13:59:01.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9758000000000004e-05 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853014+0000", 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1320000000000002e-05 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102395 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10121216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:59:01.021 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1868902250000009, 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056134649000000002, 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102395 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797088+0000", 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797089+0000", 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9309999999999998e-06 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797095+0000", 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5940000000000001e-06 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797099+0000", 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2860000000000001e-06 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853039+0000", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055939163 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853133+0000", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4854999999999999e-05 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853223+0000", 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9145000000000001e-05 2024-09-21T13:59:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102396 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10137600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1868748650000001, 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056318565000000001, 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102396 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797103+0000", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797105+0000", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2350000000000002e-06 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797111+0000", 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:59:01.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797116+0000", 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2939999999999999e-06 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853254+0000", 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056138331999999999 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853333+0000", 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9363999999999994e-05 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853422+0000", 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8350999999999995e-05 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102397 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10153984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:59:01.030 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.186858634, 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056598471999999997, 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102397 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797119+0000", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797148+0000", 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8821000000000001e-05 2024-09-21T13:59:01.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797156+0000", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7049999999999999e-06 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797161+0000", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2079999999999999e-06 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853453+0000", 2024-09-21T13:59:01.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056292498000000003 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853548+0000", 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4247999999999996e-05 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853718+0000", 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017028200000000001 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102398 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10170368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1868111710000004, 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056775582999999998, 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102398 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.035 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797167+0000", 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797166+0000", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797169+0000", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4320000000000002e-06 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797174+0000", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4659999999999998e-06 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797179+0000", 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6589999999999998e-06 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853752+0000", 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056573343999999998 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853849+0000", 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6674000000000003e-05 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853943+0000", 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3474999999999995e-05 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102399 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10186752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1867457199999993, 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882133000000001, 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102399 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797232+0000", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797235+0000", 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5809999999999999e-06 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797239+0000", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3579999999999996e-06 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797244+0000", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6979999999999997e-06 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.853970+0000", 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056726625000000003 2024-09-21T13:59:01.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854044+0000", 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3677999999999995e-05 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854115+0000", 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0605999999999995e-05 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102400 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10203136~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1867301749999992, 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057075064000000002, 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102400 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797248+0000", 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797250+0000", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1550000000000001e-06 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797256+0000", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797260+0000", 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5120000000000002e-06 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854142+0000", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056882017999999999 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854238+0000", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6197000000000001e-05 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854323+0000", 2024-09-21T13:59:01.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4507999999999998e-05 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102401 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10219520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1867122089999995, 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252537999999999, 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102401 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797266+0000", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797268+0000", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2989999999999999e-06 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797274+0000", 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8039999999999998e-06 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797278+0000", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.544e-06 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854350+0000", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057071380999999997 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854430+0000", 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0665000000000001e-05 2024-09-21T13:59:01.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854518+0000", 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8172999999999998e-05 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102402 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10235904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1866960090000003, 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057430862999999999, 2024-09-21T13:59:01.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102402 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797282+0000", 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797284+0000", 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9690000000000001e-06 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797289+0000", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4310000000000002e-06 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.797294+0000", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5539999999999999e-06 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854546+0000", 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057252270000000001 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854610+0000", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3577000000000005e-05 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.854713+0000", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103304 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102414 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10432512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:59:01.056 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1827820360000008, 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055926550999999998, 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102414 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801196+0000", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801199+0000", 2024-09-21T13:59:01.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9409999999999999e-06 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801205+0000", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801210+0000", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9219999999999996e-06 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.856973+0000", 2024-09-21T13:59:01.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.055763004999999997 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857040+0000", 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7890000000000002e-05 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857123+0000", 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2206999999999994e-05 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102415 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10448896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1827642610000009, 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056684905000000001, 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102415 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801214+0000", 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801216+0000", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801221+0000", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5300000000000004e-06 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801226+0000", 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4989999999999996e-06 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857741+0000", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056515507999999999 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857811+0000", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0222999999999995e-05 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857899+0000", 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7390000000000002e-05 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102416 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10465280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1827485630000005, 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056878169999999999, 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102416 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.065 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801230+0000", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801229+0000", 2024-09-21T13:59:01.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801232+0000", 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5050000000000002e-06 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801239+0000", 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.985e-06 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801244+0000", 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7879999999999997e-06 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.857939+0000", 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056695027000000002 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858019+0000", 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0493000000000003e-05 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858108+0000", 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8691999999999997e-05 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:102417 3.18 3:1cc39eaa:::rbd_data.11853c86949e.0000000000000006:a [read 10481664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1827302740000007, 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057035644000000003, 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:01.069 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 102417 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:01.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801248+0000", 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801250+0000", 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3020000000000002e-06 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801255+0000", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6799999999999998e-06 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.801260+0000", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5979999999999999e-06 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858134+0000", 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.056874307999999998 2024-09-21T13:59:01.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858202+0000", 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7126999999999996e-05 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:52.858283+0000", 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1959999999999995e-05 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:01.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:01.074 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:01.075 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:01.075 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:01.074+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:01.176 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:01.174+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:01.205 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:01.205 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:01.205 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:01.205 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:01.219 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:01.276 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:01.274+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:01.378 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:01.378 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:01.378 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:01.379 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:01.378+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:01.392 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:01.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:59:01.479 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:01.478+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:01.555 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone13 from 0xeb47877 (overlap 0x1364504) to 0x0 2024-09-21T13:59:01.571 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:01.571 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:01.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.760303071999999, 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:59:01.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:59:01.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:59:01.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.760233413, 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:59:01.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:59:01.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:59:01.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.760130837, 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:59:01.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.760000568000001, 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:59:01.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:59:01.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759933379, 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:59:01.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759827413, 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:59:01.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:59:01.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759672904, 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.599 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:59:01.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759618328, 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:59:01.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:59:01.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:59:01.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759518912000001, 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:59:01.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759374786, 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759311457000001, 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759211930999999, 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:01.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759068312, 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.759023849, 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.758909770000001, 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:59:01.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.758774471000001, 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:59:01.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.758468533, 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.758138432999999, 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:59:01.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.757849991000001, 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:59:01.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:01.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.757595873, 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:01.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:59:01.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:59:01.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:01.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:01.655 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:01.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:01.657 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:01.654+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:01.705 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-21T13:59:01.712 INFO:teuthology.orchestra.run.smithi079.stdout:1966 trunc from 0xeb47877 to 0xc51211b 2024-09-21T13:59:01.749 INFO:teuthology.orchestra.run.smithi079.stdout:1967 writesame 0xcd1079c thru 0xcd1da98 data_size 0x1(0xd2fd bytes) 2024-09-21T13:59:01.757 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:01.754+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:01.757 INFO:teuthology.orchestra.run.smithi079.stdout:1968 trunc from 0xcd1da99 to 0x925c4e7 2024-09-21T13:59:01.783 INFO:teuthology.orchestra.run.smithi079.stdout:1969 read 0x3ad824e thru 0x3ad950c (0x12bf bytes) 2024-09-21T13:59:01.784 INFO:teuthology.orchestra.run.smithi079.stdout:1970 write 0x5cd6ac4 thru 0x5cd9e4f (0x338c bytes) 2024-09-21T13:59:01.794 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:01.795 INFO:teuthology.orchestra.run.smithi079.stdout:1973 trunc from 0x925c4e7 to 0x9bfb222 2024-09-21T13:59:01.802 INFO:teuthology.orchestra.run.smithi079.stdout:1974 write 0x287c303 thru 0x2887094 (0xad92 bytes) 2024-09-21T13:59:01.834 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:01.834 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:01.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:01.858 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:01.854+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:01.879 INFO:teuthology.orchestra.run.smithi079.stdout:1975 writesame 0x1f985a4 thru 0x1f9e7a9 data_size 0x1(0x6206 bytes) 2024-09-21T13:59:01.897 INFO:teuthology.orchestra.run.smithi079.stdout:1976 punch from 0x732afc3 to 0x733930d, (0xe34a bytes) 2024-09-21T13:59:01.897 INFO:teuthology.orchestra.run.smithi079.stdout:1977 writesame 0x4c5f277 thru 0x4c5fd82 data_size 0xe(0xb0c bytes) 2024-09-21T13:59:01.958 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:01.958+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:01.959 INFO:teuthology.orchestra.run.smithi079.stdout:1978 trunc from 0x9bfb222 to 0xca8c91f 2024-09-21T13:59:01.969 INFO:teuthology.orchestra.run.smithi079.stdout:1979 write 0x5fc9f60 thru 0x5fd6dd6 (0xce77 bytes) 2024-09-21T13:59:01.972 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:01.972 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:01.972 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:01.973 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:01.973 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:01.980 INFO:teuthology.orchestra.run.smithi079.stdout:1980 clone 15 order 22 su 262144 sc 15 2024-09-21T13:59:01.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:02.060 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:02.058+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:02.113 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64133 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10911744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273583804999999, 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069056558000000004, 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64133 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838062+0000", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4899999999999999e-06 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838070+0000", 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5639999999999999e-06 2024-09-21T13:59:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838083+0000", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2713e-05 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906781+0000", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068698555999999994 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906938+0000", 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015647400000000001 2024-09-21T13:59:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907117+0000", 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017901899999999999 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64134 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10733568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273557493, 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069333364999999994, 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64134 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838088+0000", 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000002e-06 2024-09-21T13:59:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838093+0000", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8659999999999997e-06 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838098+0000", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8189999999999999e-06 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907174+0000", 2024-09-21T13:59:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069075937000000004 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907295+0000", 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121527 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907420+0000", 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124387 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64135 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10928128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273540812, 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595481000000001, 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64135 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838105+0000", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838115+0000", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4180000000000003e-06 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838120+0000", 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-06 2024-09-21T13:59:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907465+0000", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069345748999999998 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907550+0000", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4190999999999994e-05 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907699+0000", 2024-09-21T13:59:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014886599999999999 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64136 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10749952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273520389, 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069879827000000005, 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64136 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838125+0000", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838132+0000", 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.798e-06 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838137+0000", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3550000000000004e-06 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907777+0000", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069639767000000005 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907881+0000", 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103658 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908003+0000", 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122578 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64137 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10944512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.27342852, 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070170959000000005, 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64137 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838218+0000", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9430000000000002e-06 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838230+0000", 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-09-21T13:59:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838239+0000", 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6680000000000007e-06 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908053+0000", 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069814478999999999 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908197+0000", 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143948 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908386+0000", 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018891200000000001 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64138 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10766336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273383737, 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070426890000000006, 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64138 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838259+0000", 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838264+0000", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838274+0000", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7159999999999998e-06 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838281+0000", 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.968e-06 2024-09-21T13:59:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908460+0000", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070179149999999996 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908561+0000", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101364 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908687+0000", 2024-09-21T13:59:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012597800000000001 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64139 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10960896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.273357205, 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070767155999999998, 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64139 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838286+0000", 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838289+0000", 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838297+0000", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0649999999999999e-06 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838304+0000", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4330000000000001e-06 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908754+0000", 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070449759000000001 2024-09-21T13:59:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908904+0000", 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150168 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909054+0000", 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015012900000000001 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64140 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10782720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.272893217, 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070604650000000005, 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64140 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838309+0000", 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999558 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838772+0000", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046326800000000002 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838784+0000", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1932e-05 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838792+0000", 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1640000000000001e-06 2024-09-21T13:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909106+0000", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070314146999999994 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909226+0000", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001197 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909355+0000", 2024-09-21T13:59:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000129412 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64141 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10977280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.272381130999999, 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070343271999999998, 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64141 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838799+0000", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995365 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839267+0000", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046808499999999997 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839278+0000", 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0943e-05 2024-09-21T13:59:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839287+0000", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3259999999999996e-06 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909412+0000", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070125259999999995 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909493+0000", 2024-09-21T13:59:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1191000000000002e-05 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909606+0000", 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113001 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64142 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10799104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.272000433000001, 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070248221, 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64142 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839294+0000", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.99965 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839648+0000", 2024-09-21T13:59:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035480400000000001 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839658+0000", 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6080000000000002e-06 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839663+0000", 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.074e-06 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909646+0000", 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069982588999999998 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909769+0000", 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012363200000000001 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909892+0000", 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122342 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64143 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10993664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.271568497000001, 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070150836999999994, 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64143 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839681+0000", 2024-09-21T13:59:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996057 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840080+0000", 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000399341 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840091+0000", 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0694e-05 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840099+0000", 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909939+0000", 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069839335000000002 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910038+0000", 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9512999999999994e-05 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910226+0000", 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018791599999999999 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64144 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10815488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.270994865, 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069887875000000002, 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64144 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840121+0000", 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994721 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840653+0000", 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053217200000000003 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840662+0000", 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2600000000000005e-06 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840670+0000", 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4740000000000005e-06 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910299+0000", 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069628667000000005 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910405+0000", 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105778 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910537+0000", 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132199 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64145 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10831872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.270557291999999, 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069831590999999998, 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64145 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840703+0000", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996161 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841092+0000", 2024-09-21T13:59:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038957299999999999 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841101+0000", 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6840000000000002e-06 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841108+0000", 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910605+0000", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069497009999999998 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910760+0000", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015446000000000001 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910918+0000", 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015825299999999999 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64146 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10489856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.270011509, 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069574639999999993, 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64146 2024-09-21T13:59:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841132+0000", 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994998 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841637+0000", 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050520100000000004 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841645+0000", 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8949999999999998e-06 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841652+0000", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3620000000000002e-06 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910965+0000", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069313079 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911082+0000", 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116834 2024-09-21T13:59:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911207+0000", 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125365 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64147 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10848256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.269682046, 2024-09-21T13:59:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069517756999999999, 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64147 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841659+0000", 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996972 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841967+0000", 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030764399999999998 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841976+0000", 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6909999999999992e-06 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841984+0000", 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0059999999999992e-06 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911268+0000", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069284088999999993 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911365+0000", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6559999999999997e-05 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911480+0000", 2024-09-21T13:59:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64148 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10506240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.269251642, 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069398185000000001, 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64148 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842030+0000", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996371 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842397+0000", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036758100000000002 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842408+0000", 2024-09-21T13:59:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0438999999999999e-05 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842416+0000", 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1349999999999992e-06 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911554+0000", 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069138738000000005 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911667+0000", 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112936 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911790+0000", 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122996 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64149 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10864640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.268745955, 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069236906000000001, 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64149 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842447+0000", 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995494 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842903+0000", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045564299999999999 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842913+0000", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0193999999999999e-05 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842921+0000", 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.14e-06 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911840+0000", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068918980000000005 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911943+0000", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912135+0000", 2024-09-21T13:59:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019169 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64150 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10522624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.268253445999999, 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069209838999999995, 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64150 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842929+0000", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995384 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843395+0000", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046669300000000001 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843407+0000", 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1262e-05 2024-09-21T13:59:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843415+0000", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2609999999999993e-06 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912299+0000", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068884538999999995 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912456+0000", 2024-09-21T13:59:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015631900000000001 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912600+0000", 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014456899999999999 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64165 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10995712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.262798936999999, 2024-09-21T13:59:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069022151000000004, 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64165 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848844+0000", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848850+0000", 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2319999999999998e-06 2024-09-21T13:59:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848864+0000", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.377e-05 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848876+0000", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2396e-05 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917682+0000", 2024-09-21T13:59:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068805955000000002 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917762+0000", 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9967000000000002e-05 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917867+0000", 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104956 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64167 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10491904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.262151615000001, 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069104480999999995, 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64167 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849491+0000", 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849495+0000", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3749999999999999e-06 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849502+0000", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2749999999999998e-06 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849508+0000", 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000002e-06 2024-09-21T13:59:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918416+0000", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068908419999999998 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918494+0000", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7570000000000004e-05 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918597+0000", 2024-09-21T13:59:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102673 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.203 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:02.204 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:02.205 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:02.202+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:02.305 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:02.306+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:02.372 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:02.372 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:02.372 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:02.372 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:02.388 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:02.410 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:59:02.434 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:02.434+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:02.506 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:02.506+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:02.513 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:02.513 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:02.513 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:02.513 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:02.514 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:02.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:02.579 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone14 from 0xca8c91f (overlap 0x925c4e7) to 0x0 2024-09-21T13:59:02.618 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:02.618+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:02.708 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:02.706+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:02.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:02.752 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.875699078, 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.867821915, 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863884893, 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863873684, 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863862512000001, 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863848209, 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863812749000001, 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863799586000001, 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.863788055000001, 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859800087, 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859780454999999, 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859755627, 2024-09-21T13:59:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.85973063, 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859718559999999, 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859707240000001, 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859696099000001, 2024-09-21T13:59:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859683798000001, 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.859672546000001, 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.783602794, 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.774376218, 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:02.844 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:02.842+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:02.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:02.945 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:02.942+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:02.987 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:02.987 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:03.023 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:03.023 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:03.045 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:03.042+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:03.055 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:03.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:03.061 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:03.062 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:03.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:03.098 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:03.099 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:03.130 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:03.146 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:03.142+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:03.167 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:03.168 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:03.201 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:03.211 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:03.211 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:03.255 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:03.254+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:03.303 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:03.303 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:03.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:03.347 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:03.346+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:03.449 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:03.446+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:03.518 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:03.518 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:03.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:03.579 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:03.578+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:03.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:03.646+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:03.663 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:03.664 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:03.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:03.767 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:03.766+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:03.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:03.850+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:03.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:03.971 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:03.970+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:04.054 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:04.050+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:04.088 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.088 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:04.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:04.155 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:04.153+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:04.256 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:04.254+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:04.313 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.313 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:04.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:04.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:04.369+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:04.402 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-21T13:59:04.405 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:04.405 INFO:teuthology.orchestra.run.smithi079.stdout:1982 read 0x787809a thru 0x78789a7 (0x90e bytes) 2024-09-21T13:59:04.405 INFO:teuthology.orchestra.run.smithi079.stdout:1983 write 0x52ea669 thru 0x52f4980 (0xa318 bytes) 2024-09-21T13:59:04.434 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.434 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:04.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:59:04.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:04.458 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:04.458+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:04.487 INFO:teuthology.orchestra.run.smithi079.stdout:1985 read 0x20a6ed9 thru 0x20b472a (0xd852 bytes) 2024-09-21T13:59:04.487 INFO:teuthology.orchestra.run.smithi079.stdout:1986 write 0xa8ab909 thru 0xa8b0626 (0x4d1e bytes) 2024-09-21T13:59:04.518 INFO:teuthology.orchestra.run.smithi079.stdout:1987 writesame 0x2ff2dbe thru 0x2ff92e9 data_size 0x64(0x652c bytes) 2024-09-21T13:59:04.559 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:04.558+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:04.618 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.618 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:04.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:04.675 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:04.673+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:04.722 INFO:teuthology.orchestra.run.smithi079.stdout:1988 writesame 0xb86aa1c thru 0xb870980 data_size 0x1(0x5f65 bytes) 2024-09-21T13:59:04.756 INFO:teuthology.orchestra.run.smithi079.stdout:1989 punch from 0x4cc63af to 0x4cc9ba0, (0x37f1 bytes) 2024-09-21T13:59:04.756 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:04.756 INFO:teuthology.orchestra.run.smithi079.stdout:1991 trunc from 0xca8c91f to 0xc7f7df1 2024-09-21T13:59:04.761 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:04.758+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:04.786 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.787 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:04.797 INFO:teuthology.orchestra.run.smithi079.stdout:1992 read 0x40d54d3 thru 0x40d898c (0x34ba bytes) 2024-09-21T13:59:04.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:04.811 INFO:teuthology.orchestra.run.smithi079.stdout:1993 trunc from 0xc7f7df1 to 0x2a1d056 2024-09-21T13:59:04.865 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:04.858+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:04.962 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:04.957+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:04.992 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:04.993 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:05.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:05.101 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:05.097+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:05.163 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:05.162+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:05.202 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:05.202 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:05.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:05.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:05.264 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:05.261+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:05.353 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:05.353 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:05.363 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:05.363 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:05.366 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:05.366+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:05.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:05.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:05.380 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:05.395 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:05.395 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:05.396 INFO:teuthology.orchestra.run.smithi079.stdout:1994 punch from 0x15927ed to 0x15a1d8a, (0xf59d bytes) 2024-09-21T13:59:05.396 INFO:teuthology.orchestra.run.smithi079.stdout:1997 punch from 0x246aca1 to 0x246be41, (0x11a0 bytes) 2024-09-21T13:59:05.398 INFO:teuthology.orchestra.run.smithi079.stdout:1998 trunc from 0x2a1d056 to 0x3886a9c 2024-09-21T13:59:05.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:05.413 INFO:teuthology.orchestra.run.smithi079.stdout:1999 write 0x6250a62 thru 0x6251ace (0x106d bytes) 2024-09-21T13:59:05.417 INFO:teuthology.orchestra.run.smithi079.stdout:2000 write 0x5f6f31 thru 0x60004b (0x911b bytes) 2024-09-21T13:59:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:2003 punch from 0x22e82fb to 0x22ea8f6, (0x25fb bytes) 2024-09-21T13:59:05.430 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:59:05.431 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:05.431 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:05.442 INFO:teuthology.orchestra.run.smithi079.stdout:2004 write 0xed5e9d1 thru 0xed67e2d (0x945d bytes) 2024-09-21T13:59:05.445 INFO:teuthology.orchestra.run.smithi079.stdout:2005 read 0x587ab11 thru 0x58872ec (0xc7dc bytes) 2024-09-21T13:59:05.445 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:05.445 INFO:teuthology.orchestra.run.smithi079.stdout:2007 clone 16 order 20 su 131072 sc 8 2024-09-21T13:59:05.449 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:05.467 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:05.467 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:05.465+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:05.467 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:05.467 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:05.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:05.470 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:05.540 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:05.540 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:05.540 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:05.540 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:05.540 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:05.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:05.567 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:05.565+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:05.669 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:05.665+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865537471, 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:59:05.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:59:05.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865467811999999, 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.686 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:05.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:59:05.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:59:05.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865365235999999, 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:05.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865234966999999, 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:59:05.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:59:05.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865167778, 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:59:05.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:05.704 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.865061812, 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:59:05.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:59:05.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.708 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864907302999999, 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:59:05.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:59:05.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:59:05.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864852726999999, 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:05.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:59:05.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864753311000001, 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:05.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864609184999999, 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:59:05.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864545855999999, 2024-09-21T13:59:05.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:05.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:59:05.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.86444633, 2024-09-21T13:59:05.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.733 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864302711000001, 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:05.737 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864258247999999, 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:59:05.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:05.741 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864144168999999, 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:05.745 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.864008869999999, 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:59:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:59:05.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.863702931999999, 2024-09-21T13:59:05.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.863372832, 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.863084390000001, 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:59:05.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.862830272, 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:05.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:59:05.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:59:05.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:05.765 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:05.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:05.767 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:05.767 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:05.767 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T13:59:05.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-21T13:59:05.770 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:05.766+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:05.870 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:05.870+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:05.893 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:05.893 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:05.893 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:05.907 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:05.998 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:05.998+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:06.061 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T13:59:06.057+0000 7f74c16a6640 -1 mon.a@0(leader).osd e56 definitely_dead 0 2024-09-21T13:59:06.071 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:06.069+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:06.074 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:06.074 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:06.074 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:06.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:06.172 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:06.169+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:06.255 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:06.255 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64133 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10911744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415652779999999, 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069056558000000004, 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64133 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838062+0000", 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4899999999999999e-06 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838070+0000", 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5639999999999999e-06 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838083+0000", 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2713e-05 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906781+0000", 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068698555999999994 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906938+0000", 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015647400000000001 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907117+0000", 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017901899999999999 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64134 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10733568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415626467999999, 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069333364999999994, 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64134 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838088+0000", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000002e-06 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838093+0000", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8659999999999997e-06 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838098+0000", 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8189999999999999e-06 2024-09-21T13:59:06.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907174+0000", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069075937000000004 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907295+0000", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121527 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907420+0000", 2024-09-21T13:59:06.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124387 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64135 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10928128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415609787000001, 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595481000000001, 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64135 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838105+0000", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838115+0000", 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4180000000000003e-06 2024-09-21T13:59:06.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838120+0000", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-06 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907465+0000", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069345748999999998 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907550+0000", 2024-09-21T13:59:06.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4190999999999994e-05 2024-09-21T13:59:06.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907699+0000", 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014886599999999999 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64136 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10749952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415589363999999, 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069879827000000005, 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64136 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838125+0000", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838132+0000", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.798e-06 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838137+0000", 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3550000000000004e-06 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907777+0000", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069639767000000005 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907881+0000", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103658 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908003+0000", 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122578 2024-09-21T13:59:06.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64137 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10944512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415497495, 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070170959000000005, 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64137 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838218+0000", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9430000000000002e-06 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838230+0000", 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838239+0000", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6680000000000007e-06 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908053+0000", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069814478999999999 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908197+0000", 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143948 2024-09-21T13:59:06.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908386+0000", 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018891200000000001 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64138 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10766336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415452712, 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070426890000000006, 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64138 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838259+0000", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838264+0000", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838274+0000", 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7159999999999998e-06 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838281+0000", 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.968e-06 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908460+0000", 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070179149999999996 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908561+0000", 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101364 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908687+0000", 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012597800000000001 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64139 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10960896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.415426180000001, 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070767155999999998, 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64139 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838286+0000", 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838289+0000", 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838297+0000", 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0649999999999999e-06 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838304+0000", 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4330000000000001e-06 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908754+0000", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070449759000000001 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908904+0000", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150168 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909054+0000", 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015012900000000001 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64140 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10782720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.414962192000001, 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070604650000000005, 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64140 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838309+0000", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999558 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838772+0000", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046326800000000002 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838784+0000", 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1932e-05 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838792+0000", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1640000000000001e-06 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909106+0000", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070314146999999994 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909226+0000", 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001197 2024-09-21T13:59:06.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909355+0000", 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000129412 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64141 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10977280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.414450106, 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070343271999999998, 2024-09-21T13:59:06.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64141 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838799+0000", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995365 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839267+0000", 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046808499999999997 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839278+0000", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0943e-05 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839287+0000", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3259999999999996e-06 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909412+0000", 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070125259999999995 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909493+0000", 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1191000000000002e-05 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909606+0000", 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113001 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64142 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10799104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.414069408, 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070248221, 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64142 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839294+0000", 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.99965 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839648+0000", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035480400000000001 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839658+0000", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6080000000000002e-06 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839663+0000", 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.074e-06 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909646+0000", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069982588999999998 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909769+0000", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012363200000000001 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909892+0000", 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122342 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64143 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10993664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.413637472000001, 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070150836999999994, 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64143 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839681+0000", 2024-09-21T13:59:06.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996057 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840080+0000", 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000399341 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840091+0000", 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0694e-05 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840099+0000", 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909939+0000", 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069839335000000002 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910038+0000", 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9512999999999994e-05 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910226+0000", 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018791599999999999 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64144 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10815488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.41306384, 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069887875000000002, 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64144 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840121+0000", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994721 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840653+0000", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053217200000000003 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840662+0000", 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2600000000000005e-06 2024-09-21T13:59:06.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840670+0000", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4740000000000005e-06 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910299+0000", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069628667000000005 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910405+0000", 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105778 2024-09-21T13:59:06.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910537+0000", 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132199 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64145 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10831872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.412626267, 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069831590999999998, 2024-09-21T13:59:06.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64145 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840703+0000", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996161 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841092+0000", 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038957299999999999 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841101+0000", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6840000000000002e-06 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841108+0000", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910605+0000", 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069497009999999998 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910760+0000", 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015446000000000001 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910918+0000", 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015825299999999999 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64146 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10489856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.412080484000001, 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069574639999999993, 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64146 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:06.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841132+0000", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994998 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841637+0000", 2024-09-21T13:59:06.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050520100000000004 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841645+0000", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8949999999999998e-06 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841652+0000", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3620000000000002e-06 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910965+0000", 2024-09-21T13:59:06.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069313079 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911082+0000", 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116834 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911207+0000", 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125365 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64147 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10848256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.411751021000001, 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069517756999999999, 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64147 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841659+0000", 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996972 2024-09-21T13:59:06.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841967+0000", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030764399999999998 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841976+0000", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6909999999999992e-06 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841984+0000", 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0059999999999992e-06 2024-09-21T13:59:06.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911268+0000", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069284088999999993 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911365+0000", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6559999999999997e-05 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911480+0000", 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-09-21T13:59:06.321 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64148 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10506240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.411320617000001, 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069398185000000001, 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.322 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64148 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842030+0000", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996371 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842397+0000", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036758100000000002 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842408+0000", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0438999999999999e-05 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842416+0000", 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1349999999999992e-06 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911554+0000", 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069138738000000005 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911667+0000", 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112936 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911790+0000", 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122996 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64149 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10864640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.410814930000001, 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069236906000000001, 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64149 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842447+0000", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995494 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842903+0000", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045564299999999999 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842913+0000", 2024-09-21T13:59:06.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0193999999999999e-05 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842921+0000", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.14e-06 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911840+0000", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068918980000000005 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911943+0000", 2024-09-21T13:59:06.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912135+0000", 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019169 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64150 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10522624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.410322421, 2024-09-21T13:59:06.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069209838999999995, 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64150 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842929+0000", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995384 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843395+0000", 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046669300000000001 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843407+0000", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1262e-05 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843415+0000", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2609999999999993e-06 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912299+0000", 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068884538999999995 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912456+0000", 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015631900000000001 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912600+0000", 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014456899999999999 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.334 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64165 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10995712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.404867912, 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069022151000000004, 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64165 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:06.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848844+0000", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848850+0000", 2024-09-21T13:59:06.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2319999999999998e-06 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848864+0000", 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.377e-05 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848876+0000", 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2396e-05 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917682+0000", 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068805955000000002 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917762+0000", 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9967000000000002e-05 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917867+0000", 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104956 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64167 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10491904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.404220590000001, 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069104480999999995, 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64167 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849491+0000", 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:06.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849495+0000", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3749999999999999e-06 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849502+0000", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2749999999999998e-06 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849508+0000", 2024-09-21T13:59:06.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000002e-06 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918416+0000", 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068908419999999998 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918494+0000", 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7570000000000004e-05 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918597+0000", 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102673 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.343 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:06.344 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:06.345 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:06.341+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:06.437 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.1. 2024-09-21T13:59:06.445 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:06.442+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:06.475 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:06.475 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:06.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:06.578 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:06.578+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:06.647 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:06.645+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:06.657 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:06.657 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:06.657 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:06.657 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:06.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:06.747 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:06.745+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:06.837 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:06.837 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.958671628000001, 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:06.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:06.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:06.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:06.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.950794465000001, 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:06.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946857442999999, 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:06.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:06.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946846233999999, 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:06.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946835062000002, 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:06.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:06.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946820759000001, 2024-09-21T13:59:06.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:06.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946785298999998, 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:06.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946772136, 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.946760605000001, 2024-09-21T13:59:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942772637000001, 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942753005, 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942728176999999, 2024-09-21T13:59:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942703179999999, 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942691109999998, 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.94267979, 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942668649000002, 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942656348, 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.942645096, 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.866575344000001, 2024-09-21T13:59:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.857348768000001, 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:06.936 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:06.938 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:06.938+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:06.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:07.038 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:07.033+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:07.066 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:07.067 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:07.067 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:07.067 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:07.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:07.139 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:07.138+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:07.233 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:07.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:07.237+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:07.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:07.342 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:07.337+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.801317574999999, 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:07.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:07.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:07.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126315 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 200704~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.414 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869890665, 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049919573000000002, 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126315 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:07.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537479+0000", 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537481+0000", 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1069999999999999e-06 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537483+0000", 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.824e-06 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537486+0000", 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3970000000000001e-06 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587036+0000", 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049550084000000001 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587126+0000", 2024-09-21T13:59:07.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0150999999999998e-05 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587399+0000", 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000273229 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.419 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126316 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 227328~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869882574, 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050221382000000002, 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126316 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537487+0000", 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537492+0000", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1080000000000003e-06 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537495+0000", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1480000000000002e-06 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537497+0000", 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3250000000000002e-06 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587474+0000", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049977374999999997 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587563+0000", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8508e-05 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587709+0000", 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146129 2024-09-21T13:59:07.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126317 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 247808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869870926000001, 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050473885000000003, 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.424 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126317 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:07.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537504+0000", 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7729999999999999e-06 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537509+0000", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5319999999999997e-06 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537512+0000", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4729999999999999e-06 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587758+0000", 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050246489999999998 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587848+0000", 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9950000000000004e-05 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587973+0000", 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012499700000000001 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.428 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126369 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869854405, 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050784915, 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126369 2024-09-21T13:59:07.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537515+0000", 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537517+0000", 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.984e-06 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537524+0000", 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537533+0000", 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9360000000000005e-06 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587999+0000", 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050466364999999999 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588044+0000", 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5015999999999997e-05 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588301+0000", 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025690000000000001 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126370 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 30720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.433 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869833592999999, 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050926705000000003, 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126370 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537536+0000", 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537538+0000", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537544+0000", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4689999999999996e-06 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537548+0000", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588328+0000", 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050779457 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588384+0000", 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6156999999999998e-05 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588463+0000", 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9390999999999999e-05 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126371 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869818072999999, 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051068768, 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126371 2024-09-21T13:59:07.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537554+0000", 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9719999999999999e-06 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537559+0000", 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537564+0000", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4399999999999998e-06 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588488+0000", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050924687000000003 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588551+0000", 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2268999999999996e-05 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588621+0000", 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0227000000000004e-05 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126372 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869802859, 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051259907, 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.442 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126372 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:07.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537569+0000", 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9910000000000001e-06 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537575+0000", 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7570000000000001e-06 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537579+0000", 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3649999999999997e-06 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588646+0000", 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051067250000000002 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588712+0000", 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5172000000000006e-05 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588827+0000", 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011572 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126373 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.446 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869786960000001, 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051569028000000003, 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126373 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:07.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537585+0000", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.852e-06 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537591+0000", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.728e-06 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537595+0000", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588853+0000", 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051257748999999998 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588909+0000", 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6140000000000001e-05 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589152+0000", 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000243432 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869771835, 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.451 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869756467, 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:07.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:07.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869741317000001, 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:07.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.869705804000001, 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:07.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:140999 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5241142820000002, 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049766019000000002, 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 140999 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:07.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:07.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883261+0000", 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1460000000000004e-06 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883268+0000", 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.447e-06 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883273+0000", 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.932729+0000", 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049455486999999999 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.932809+0000", 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0445000000000007e-05 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933022+0000", 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000212635 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141000 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 431104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5240927270000002, 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050082146000000001, 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141000 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883277+0000", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883280+0000", 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.34e-06 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883287+0000", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.559e-06 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883292+0000", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8690000000000003e-06 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933051+0000", 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049758720999999999 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933129+0000", 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8677999999999994e-05 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933360+0000", 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000230354 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141001 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5240741040000003, 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050465547999999999, 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141001 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:07.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883298+0000", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883306+0000", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4150000000000002e-06 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883310+0000", 2024-09-21T13:59:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933440+0000", 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050129114000000002 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933522+0000", 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2812000000000006e-05 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933762+0000", 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023933900000000001 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141002 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 441344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5240555489999998, 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050811505999999999, 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141002 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:07.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883314+0000", 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883317+0000", 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.323e-06 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883323+0000", 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2389999999999999e-06 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883330+0000", 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1080000000000004e-06 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933791+0000", 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050460855999999998 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933869+0000", 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8596000000000004e-05 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934126+0000", 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025674500000000001 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141003 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5240357959999997, 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051137289000000002, 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141003 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:07.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883336+0000", 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883344+0000", 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-06 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883349+0000", 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8250000000000004e-06 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934156+0000", 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050807057000000003 2024-09-21T13:59:07.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934234+0000", 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7729000000000001e-05 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934472+0000", 2024-09-21T13:59:07.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023826899999999999 2024-09-21T13:59:07.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141004 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 451584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:07.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5240173669999999, 2024-09-21T13:59:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.05147119, 2024-09-21T13:59:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141004 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:07.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883355+0000", 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2340000000000001e-06 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883362+0000", 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4189999999999996e-06 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883367+0000", 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934501+0000", 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051133396999999997 2024-09-21T13:59:07.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934579+0000", 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7818999999999995e-05 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934824+0000", 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024550599999999999 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5239987990000001, 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:07.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:07.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:07.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:07.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:07.514 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:07.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:59:07.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:07.516 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:07.514+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:07.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:07.655 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:07.653+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:07.696 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:07.712 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:07.712 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:07.718 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:07.718+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:07.721 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:07.721 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:07.729 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:07.729 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:07.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:07.745 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:07.745 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:07.765 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:07.819 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:07.817+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:07.854 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:07.854 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:07.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:07.920 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:07.918+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:07.987 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:07.987 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:08.007 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:08.007 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:08.007 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:08.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:08.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:08.021 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:08.018+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:08.027 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.027 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:08.131 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:08.129+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:08.157 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:59:08.208 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.209 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.222 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:08.222+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:08.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:08.303 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone15 from 0xed67e2e (overlap 0x2a1d056) to 0x4361a2 2024-09-21T13:59:08.323 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:08.321+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:08.394 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.394 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:08.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:08.449+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:08.523 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-21T13:59:08.524 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:08.521+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:08.547 INFO:teuthology.orchestra.run.smithi079.stdout:2008 trunc from 0xed67e2e to 0x104397 2024-09-21T13:59:08.587 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.587 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:08.604 INFO:teuthology.orchestra.run.smithi079.stdout:2010 read 0x8504b thru 0x9357b (0xe531 bytes) 2024-09-21T13:59:08.606 INFO:teuthology.orchestra.run.smithi079.stdout:2012 read 0x42d80 thru 0x48509 (0x578a bytes) 2024-09-21T13:59:08.625 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:08.622+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:08.632 INFO:teuthology.orchestra.run.smithi079.stdout:2013 trunc from 0x104397 to 0xce3ee6a 2024-09-21T13:59:08.643 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.643 INFO:teuthology.orchestra.run.smithi079.stdout:2015 writesame 0x9ac4e37 thru 0x9acb3ec data_size 0x2f(0x65b6 bytes) 2024-09-21T13:59:08.649 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.662 INFO:teuthology.orchestra.run.smithi079.stdout:2021 trunc from 0xce3ee6a to 0x5f91d6d 2024-09-21T13:59:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:2022 trunc from 0x5f91d6d to 0x439dc3 2024-09-21T13:59:08.705 INFO:teuthology.orchestra.run.smithi079.stdout:2023 punch from 0x3fbe51 to 0x40ad46, (0xeef5 bytes) 2024-09-21T13:59:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:2024 read 0x412106 thru 0x41ed86 (0xcc81 bytes) 2024-09-21T13:59:08.706 INFO:teuthology.orchestra.run.smithi079.stdout:2025 read 0x2de2bc thru 0x2eb456 (0xd19b bytes) 2024-09-21T13:59:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:2026 punch from 0x2d1954 to 0x2dcdeb, (0xb497 bytes) 2024-09-21T13:59:08.726 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:08.721+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:08.730 INFO:teuthology.orchestra.run.smithi079.stdout:2027 writesame 0x62d7c4c thru 0x62dc0d9 data_size 0x75(0x448e bytes) 2024-09-21T13:59:08.730 INFO:teuthology.orchestra.run.smithi079.stdout:2028 read 0x58ef85e thru 0x58f4f99 (0x573c bytes) 2024-09-21T13:59:08.734 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.734 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:08.756 INFO:teuthology.orchestra.run.smithi079.stdout:2029 writesame 0xe36e9e0 thru 0xe37b928 data_size 0x1(0xcf49 bytes) 2024-09-21T13:59:08.756 INFO:teuthology.orchestra.run.smithi079.stdout:2030 write 0x5564161 thru 0x55647d0 (0x670 bytes) 2024-09-21T13:59:08.761 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.770 INFO:teuthology.orchestra.run.smithi079.stdout:2035 trunc from 0xe37b929 to 0x89d4135 2024-09-21T13:59:08.778 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.778 INFO:teuthology.orchestra.run.smithi079.stdout:2039 punch from 0x35f5a27 to 0x35fd580, (0x7b59 bytes) 2024-09-21T13:59:08.778 INFO:teuthology.orchestra.run.smithi079.stdout:2041 read 0x3cfd0c5 thru 0x3d09b2e (0xca6a bytes) 2024-09-21T13:59:08.778 INFO:teuthology.orchestra.run.smithi079.stdout:2042 punch from 0x2f9e319 to 0x2fa3753, (0x543a bytes) 2024-09-21T13:59:08.791 INFO:teuthology.orchestra.run.smithi079.stdout:2043 writesame 0xd7c6bd9 thru 0xd7ce4d3 data_size 0x1(0x78fb bytes) 2024-09-21T13:59:08.791 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.791 INFO:teuthology.orchestra.run.smithi079.stdout:2047 writesame 0xa266744 thru 0xa275de7 data_size 0x23(0xf6a4 bytes) 2024-09-21T13:59:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:2051 read 0x16db3cb thru 0x16e4770 (0x93a6 bytes) 2024-09-21T13:59:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:2052 writesame 0x7f46ca2 thru 0x7f4fc7d data_size 0x84(0x8fdc bytes) 2024-09-21T13:59:08.802 INFO:teuthology.orchestra.run.smithi079.stdout:2053 write 0x62bb437 thru 0x62bd382 (0x1f4c bytes) 2024-09-21T13:59:08.809 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.809 INFO:teuthology.orchestra.run.smithi079.stdout:2057 punch from 0x2e69e3d to 0x2e74530, (0xa6f3 bytes) 2024-09-21T13:59:08.809 INFO:teuthology.orchestra.run.smithi079.stdout:2059 read 0x5aee2ac thru 0x5afd81c (0xf571 bytes) 2024-09-21T13:59:08.818 INFO:teuthology.orchestra.run.smithi079.stdout:2060 write 0xdb1d4da thru 0xdb23e98 (0x69bf bytes) 2024-09-21T13:59:08.826 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:08.821+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:08.839 INFO:teuthology.orchestra.run.smithi079.stdout:2061 trunc from 0xdb23e99 to 0x3cb5558 2024-09-21T13:59:08.859 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.859 INFO:teuthology.orchestra.run.smithi079.stdout:2064 read 0x2c22d33 thru 0x2c2c75c (0x9a2a bytes) 2024-09-21T13:59:08.859 INFO:teuthology.orchestra.run.smithi079.stdout:2065 read 0x2ada501 thru 0x2ae0b00 (0x6600 bytes) 2024-09-21T13:59:08.859 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:08.867 INFO:teuthology.orchestra.run.smithi079.stdout:2067 trunc from 0x3cb5558 to 0x9053d59 2024-09-21T13:59:08.877 INFO:teuthology.orchestra.run.smithi079.stdout:2068 read 0x23ec820 thru 0x23f8c92 (0xc473 bytes) 2024-09-21T13:59:08.877 INFO:teuthology.orchestra.run.smithi079.stdout:2070 write 0x8730a71 thru 0x874024f (0xf7df bytes) 2024-09-21T13:59:08.887 INFO:teuthology.orchestra.run.smithi079.stdout:2071 punch from 0x38146fb to 0x381c6f1, (0x7ff6 bytes) 2024-09-21T13:59:08.887 INFO:teuthology.orchestra.run.smithi079.stdout:2072 read 0x49f0322 thru 0x49fd5a3 (0xd282 bytes) 2024-09-21T13:59:08.887 INFO:teuthology.orchestra.run.smithi079.stdout:2073 read 0x6069d5d thru 0x6074ea2 (0xb146 bytes) 2024-09-21T13:59:08.887 INFO:teuthology.orchestra.run.smithi079.stdout:2074 write 0x4124200 thru 0x41301db (0xbfdc bytes) 2024-09-21T13:59:08.890 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:08.891 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:08.893 INFO:teuthology.orchestra.run.smithi079.stdout:2077 punch from 0x8144319 to 0x8152f9a, (0xec81 bytes) 2024-09-21T13:59:08.901 INFO:teuthology.orchestra.run.smithi079.stdout:2078 trunc from 0x9053d59 to 0x443fe15 2024-09-21T13:59:08.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:08.936 INFO:teuthology.orchestra.run.smithi079.stdout:2079 trunc from 0x443fe15 to 0x87ec3a6 2024-09-21T13:59:08.936 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:08.933+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:08.946 INFO:teuthology.orchestra.run.smithi079.stdout:2080 clone 17 order 21 su 65536 sc 15 2024-09-21T13:59:09.028 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:09.026+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:09.058 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.059 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.073 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:09.129 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:09.125+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:09.211 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.211 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:09.230 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:09.229+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:09.331 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:09.329+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:09.347 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.347 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:09.432 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:09.430+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:09.482 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.482 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:09.538 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:09.538+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:09.634 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:09.629+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:09.660 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.661 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.675 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:09.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:09.733+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:09.796 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.796 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:09.836 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:09.837+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:09.928 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:09.928 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:09.937 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:09.933+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:09.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:10.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:10.055 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:10.053+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:10.063 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:10.063 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:10.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:10.138 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:10.138+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:10.167 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:10.167 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:10.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:59:10.189 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:10.189 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:10.200 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:10.200 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:10.206 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:10.206 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:10.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:10.224 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:10.224 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:10.239 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:10.237+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:10.242 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:10.242 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:10.261 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:10.261 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:10.284 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone16 from 0x87ec3a6 (overlap 0x104397) to 0x6816f 2024-09-21T13:59:10.295 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:10.295 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:10.298 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:10.303 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:10.303 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:10.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:10.345+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.516198919000001, 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.508321756000001, 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504384733999999, 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504373524999998, 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:10.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504362353000001, 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504348050000001, 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:10.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504312590000001, 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:10.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504299426999999, 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:10.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.504287896000001, 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500299928, 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:10.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:10.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500280296, 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:10.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500255467999999, 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:10.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500230470999998, 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:10.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:10.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500218401000001, 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:10.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:10.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500207080999999, 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:10.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:10.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500195940000001, 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:10.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500183638999999, 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.500172386999999, 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:10.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:10.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.424102635000001, 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:10.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:10.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:10.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.414876059000001, 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:10.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:10.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:10.480 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:10.481 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-21T13:59:10.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:10.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:10.477+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:10.493 INFO:teuthology.orchestra.run.smithi079.stdout:2081 read 0x4353e0c thru 0x4357882 (0x3a77 bytes) 2024-09-21T13:59:10.495 INFO:teuthology.orchestra.run.smithi079.stdout:2083 punch from 0x2471665 to 0x2478c64, (0x75ff bytes) 2024-09-21T13:59:10.500 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:10.509 INFO:teuthology.orchestra.run.smithi079.stdout:2085 trunc from 0x87ec3a6 to 0xe6b50f0 2024-09-21T13:59:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:2087 read 0xc025da4 thru 0xc02dbfc (0x7e59 bytes) 2024-09-21T13:59:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:2089 punch from 0x6903b4a to 0x690c2a8, (0x875e bytes) 2024-09-21T13:59:10.518 INFO:teuthology.orchestra.run.smithi079.stdout:2091 write 0xcf10316 thru 0xcf133b9 (0x30a4 bytes) 2024-09-21T13:59:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:2092 punch from 0x2887d53 to 0x288c8dd, (0x4b8a bytes) 2024-09-21T13:59:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:2093 punch from 0xb8e8269 to 0xb8ece00, (0x4b97 bytes) 2024-09-21T13:59:10.523 INFO:teuthology.orchestra.run.smithi079.stdout:2095 writesame 0x548a109 thru 0x5496109 data_size 0x13(0xc001 bytes) 2024-09-21T13:59:10.531 INFO:teuthology.orchestra.run.smithi079.stdout:2096 punch from 0xcc7ac72 to 0xcc83a7e, (0x8e0c bytes) 2024-09-21T13:59:10.531 INFO:teuthology.orchestra.run.smithi079.stdout:2097 read 0x68ae97 thru 0x690a6d (0x5bd7 bytes) 2024-09-21T13:59:10.532 INFO:teuthology.orchestra.run.smithi079.stdout:2098 write 0xc76bfd thru 0xc7d117 (0x651b bytes) 2024-09-21T13:59:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:2100 write 0xeab7ee1 thru 0xeac265a (0xa77a bytes) 2024-09-21T13:59:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:2101 punch from 0x173c056 to 0x1747758, (0xb702 bytes) 2024-09-21T13:59:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:2102 punch from 0x4640800 to 0x46490d6, (0x88d6 bytes) 2024-09-21T13:59:10.558 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:10.579 INFO:teuthology.orchestra.run.smithi079.stdout:2105 trunc from 0xeac265b to 0xb7fd2b 2024-09-21T13:59:10.583 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:10.582+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:169240 3.6 3:64ab75dd:::rbd_object_map.118529705d2b:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:10.599950+0000", 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018663898000000002, 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018721818000000001, 2024-09-21T13:59:10.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 169240 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599950+0000", 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599950+0000", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599950+0000", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599955+0000", 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7950000000000004e-06 2024-09-21T13:59:10.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599972+0000", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6728e-05 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599982+0000", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0458e-05 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.615085+0000", 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015102986000000001 2024-09-21T13:59:10.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.615237+0000", 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015172100000000001 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.615589+0000", 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035141000000000003 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:169241 3.6 3:64ab75dd:::rbd_object_map.118529705d2b:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:10.599992+0000", 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018622159999999999, 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018858928, 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 169241 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599992+0000", 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599992+0000", 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599991+0000", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.599997+0000", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9549999999999997e-06 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600007+0000", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0037000000000001e-05 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600013+0000", 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.682e-06 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.616083+0000", 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016069940000000001 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.616216+0000", 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000133616 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.617005+0000", 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078812399999999996 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:169242 3.6 3:64ab75dd:::rbd_object_map.118529705d2b:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:10.600018+0000", 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018595726999999999, 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018967885, 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-21T13:59:10.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 169242 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600018+0000", 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600018+0000", 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600018+0000", 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600021+0000", 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5580000000000001e-06 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600030+0000", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4419999999999998e-06 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600035+0000", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.254e-06 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618255+0000", 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018220137000000001 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618463+0000", 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207407 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618679+0000", 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021593 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:169243 3.6 3:64ab75dd:::rbd_object_map.118529705d2b:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-21T13:59:10.631 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:10.600045+0000", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.018569608000000001, 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019049817, 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 169243 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600045+0000", 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600045+0000", 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600044+0000", 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600048+0000", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9500000000000003e-06 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600057+0000", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9709999999999993e-06 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.600062+0000", 2024-09-21T13:59:10.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.434e-06 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618970+0000", 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.018907446000000001 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.619016+0000", 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5998999999999998e-05 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:169240 3.6 e61/39)", 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:10.618604+0000", 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.0165e-05, 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065096299999999995, 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618604+0000", 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618604+0000", 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618602+0000", 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:10.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618613+0000", 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0750999999999999e-05 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618635+0000", 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2002e-05 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:10.618650+0000", 2024-09-21T13:59:10.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4405e-05 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 5 2024-09-21T13:59:10.641 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:10.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:10.643 INFO:teuthology.orchestra.run.smithi079.stdout:2106 trunc from 0xb7fd2b to 0x33b8227 2024-09-21T13:59:10.646 INFO:teuthology.orchestra.run.smithi079.stdout:2107 punch from 0x67c316 to 0x67e8ed, (0x25d7 bytes) 2024-09-21T13:59:10.646 INFO:teuthology.orchestra.run.smithi079.stdout:2108 read 0x3321779 thru 0x3321a09 (0x291 bytes) 2024-09-21T13:59:10.667 INFO:teuthology.orchestra.run.smithi079.stdout:2109 writesame 0xa7a8c8f thru 0xa7b24bc data_size 0x6(0x982e bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2110 punch from 0x6466348 to 0x647022a, (0x9ee2 bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2111 read 0x266c43b thru 0x2679b36 (0xd6fc bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2113 read 0x441de01 thru 0x442c661 (0xe861 bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2115 read 0x643ceec thru 0x644c7d7 (0xf8ec bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2116 punch from 0x70b22a8 to 0x70c17df, (0xf537 bytes) 2024-09-21T13:59:10.668 INFO:teuthology.orchestra.run.smithi079.stdout:2117 read 0x73758e6 thru 0x738436b (0xea86 bytes) 2024-09-21T13:59:10.677 INFO:teuthology.orchestra.run.smithi079.stdout:2118 write 0xb10f1eb thru 0xb10ffe8 (0xdfe bytes) 2024-09-21T13:59:10.683 INFO:teuthology.orchestra.run.smithi079.stdout:2119 write 0x9579336 thru 0x957a2aa (0xf75 bytes) 2024-09-21T13:59:10.683 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:10.681+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:10.686 INFO:teuthology.orchestra.run.smithi079.stdout:2121 read 0x17a1ce3 thru 0x17a4fc9 (0x32e7 bytes) 2024-09-21T13:59:10.688 INFO:teuthology.orchestra.run.smithi079.stdout:2122 read 0x8a6af11 thru 0x8a76346 (0xb436 bytes) 2024-09-21T13:59:10.688 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:10.688 INFO:teuthology.orchestra.run.smithi079.stdout:2124 write 0x6918f16 thru 0x692890c (0xf9f7 bytes) 2024-09-21T13:59:10.694 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:10.694 INFO:teuthology.orchestra.run.smithi079.stdout:2127 write 0x56d38f3 thru 0x56dc19a (0x88a8 bytes) 2024-09-21T13:59:10.701 INFO:teuthology.orchestra.run.smithi079.stdout:2128 read 0x95205f1 thru 0x952b86b (0xb27b bytes) 2024-09-21T13:59:10.701 INFO:teuthology.orchestra.run.smithi079.stdout:2130 writesame 0x925c454 thru 0x926184c data_size 0x25(0x53f9 bytes) 2024-09-21T13:59:10.708 INFO:teuthology.orchestra.run.smithi079.stdout:2131 write 0x80048d4 thru 0x800a92f (0x605c bytes) 2024-09-21T13:59:10.712 INFO:teuthology.orchestra.run.smithi079.stdout:2133 clone 18 order 21 su 32768 sc 15 2024-09-21T13:59:10.766 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:10.767 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:10.767 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:10.767 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:10.767 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:10.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:10.823 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:10.821+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:10.885 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:10.882+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.342200312999999, 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126315 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 200704~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410773403, 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049919573000000002, 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126315 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537480+0000", 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537479+0000", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537481+0000", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1069999999999999e-06 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537483+0000", 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.824e-06 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537486+0000", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3970000000000001e-06 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587036+0000", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049550084000000001 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587126+0000", 2024-09-21T13:59:10.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0150999999999998e-05 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587399+0000", 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000273229 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126316 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 227328~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410765312000001, 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050221382000000002, 2024-09-21T13:59:10.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126316 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537487+0000", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537492+0000", 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1080000000000003e-06 2024-09-21T13:59:10.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537495+0000", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1480000000000002e-06 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537497+0000", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3250000000000002e-06 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587474+0000", 2024-09-21T13:59:10.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049977374999999997 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587563+0000", 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8508e-05 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587709+0000", 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146129 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126317 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 247808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410753664, 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050473885000000003, 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126317 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537504+0000", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7729999999999999e-06 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537509+0000", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5319999999999997e-06 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537512+0000", 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4729999999999999e-06 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587758+0000", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050246489999999998 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587848+0000", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9950000000000004e-05 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587973+0000", 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012499700000000001 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126369 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410737143, 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050784915, 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126369 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537515+0000", 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537517+0000", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.984e-06 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537524+0000", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537533+0000", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9360000000000005e-06 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587999+0000", 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050466364999999999 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588044+0000", 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5015999999999997e-05 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588301+0000", 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025690000000000001 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126370 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 30720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410716331, 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050926705000000003, 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126370 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537536+0000", 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537538+0000", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537544+0000", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4689999999999996e-06 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537548+0000", 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:10.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588328+0000", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050779457 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588384+0000", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6156999999999998e-05 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588463+0000", 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9390999999999999e-05 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.975 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126371 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410700811, 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051068768, 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126371 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.976 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537554+0000", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9719999999999999e-06 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537559+0000", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537564+0000", 2024-09-21T13:59:10.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4399999999999998e-06 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588488+0000", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050924687000000003 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588551+0000", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2268999999999996e-05 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588621+0000", 2024-09-21T13:59:10.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0227000000000004e-05 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126372 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410685597000001, 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051259907, 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126372 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537569+0000", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9910000000000001e-06 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537575+0000", 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7570000000000001e-06 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537579+0000", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3649999999999997e-06 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588646+0000", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051067250000000002 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588712+0000", 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5172000000000006e-05 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588827+0000", 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011572 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126373 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410669698, 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051569028000000003, 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.984 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126373 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537585+0000", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.852e-06 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537591+0000", 2024-09-21T13:59:10.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.728e-06 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537595+0000", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588853+0000", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051257748999999998 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588909+0000", 2024-09-21T13:59:10.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6140000000000001e-05 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589152+0000", 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000243432 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410654573, 2024-09-21T13:59:10.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.992 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410639205000001, 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:10.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:10.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410624055, 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:10.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:10.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:11.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.410588541999999, 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:11.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:140999 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649970199999998, 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049766019000000002, 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 140999 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883256+0000", 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883261+0000", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1460000000000004e-06 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883268+0000", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.447e-06 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883273+0000", 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T13:59:11.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.932729+0000", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049455486999999999 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.932809+0000", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0445000000000007e-05 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933022+0000", 2024-09-21T13:59:11.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000212635 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141000 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 431104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649754649999998, 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050082146000000001, 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141000 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883277+0000", 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883280+0000", 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.34e-06 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883287+0000", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.559e-06 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883292+0000", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8690000000000003e-06 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933051+0000", 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049758720999999999 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933129+0000", 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8677999999999994e-05 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933360+0000", 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000230354 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141001 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649568420000008, 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050465547999999999, 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141001 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883298+0000", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883306+0000", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4150000000000002e-06 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883310+0000", 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933440+0000", 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050129114000000002 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933522+0000", 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2812000000000006e-05 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933762+0000", 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023933900000000001 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141002 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 441344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649382870000004, 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050811505999999999, 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141002 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883314+0000", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883317+0000", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.323e-06 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883323+0000", 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2389999999999999e-06 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883330+0000", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1080000000000004e-06 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933791+0000", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050460855999999998 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933869+0000", 2024-09-21T13:59:11.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8596000000000004e-05 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934126+0000", 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025674500000000001 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141003 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649185340000002, 2024-09-21T13:59:11.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051137289000000002, 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141003 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883336+0000", 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:11.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883344+0000", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-06 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883349+0000", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8250000000000004e-06 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934156+0000", 2024-09-21T13:59:11.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050807057000000003 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934234+0000", 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7729000000000001e-05 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934472+0000", 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023826899999999999 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141004 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 451584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0649001049999995, 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.05147119, 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141004 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883355+0000", 2024-09-21T13:59:11.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2340000000000001e-06 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883362+0000", 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4189999999999996e-06 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883367+0000", 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934501+0000", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051133396999999997 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934579+0000", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7818999999999995e-05 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934824+0000", 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024550599999999999 2024-09-21T13:59:11.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0648815369999998, 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:11.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:11.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.036 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:11.038 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:11.038+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:11.138 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:11.138+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:11.162 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:11.162 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.176 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:59:11.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:11.243 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:11.241+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:11.304 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:11.304 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:11.339 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:11.338+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:11.360 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone17 from 0xb10ffe9 (overlap 0xb7fd2b) to 0x0 2024-09-21T13:59:11.440 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:11.437+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:11.461 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:11.461 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:11.462 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-21T13:59:11.462 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T13:59:11.462 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T13:59:11.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-21T13:59:11.495 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.658401347000002, 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:11.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:11.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.518377907000001, 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:11.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.490118901999999, 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:11.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:11.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.593010356999997, 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:11.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:11.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.592948888000002, 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:11.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:11.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:11.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.584778137999997, 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:59:11.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:59:11.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583884912999999, 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:11.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583827153000001, 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:11.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:11.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583808560999998, 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583796223, 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:11.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:11.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583774486999999, 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.542 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:11.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583751304000003, 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:11.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:11.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583730875000001, 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:11.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.554 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583716076999998, 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:11.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583691493000003, 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:11.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583674797, 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:11.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.583652559999997, 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:11.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.665364257, 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:11.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:11.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:11.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.577 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.495845709000001, 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:11.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.132607114999999, 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:11.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:11.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:11.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:11.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:11.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:11.589 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:11.591 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.591 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T13:59:11.591 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.591 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:11.585+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:11.619 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-21T13:59:11.631 INFO:teuthology.orchestra.run.smithi079.stdout:2134 trunc from 0xb10ffe9 to 0x65b2a74 2024-09-21T13:59:11.686 INFO:teuthology.orchestra.run.smithi079.stdout:2135 write 0x3668c8 thru 0x36e39a (0x7ad3 bytes) 2024-09-21T13:59:11.691 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:11.689+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:11.723 INFO:teuthology.orchestra.run.smithi079.stdout:2136 read 0x4f734da thru 0x4f74fb1 (0x1ad8 bytes) 2024-09-21T13:59:11.723 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:11.723 INFO:teuthology.orchestra.run.smithi079.stdout:2139 punch from 0x49a520d to 0x49aece1, (0x9ad4 bytes) 2024-09-21T13:59:11.724 INFO:teuthology.orchestra.run.smithi079.stdout:2141 punch from 0x2d9ea6c to 0x2da53bb, (0x694f bytes) 2024-09-21T13:59:11.724 INFO:teuthology.orchestra.run.smithi079.stdout:2142 write 0x628f671 thru 0x629a2f9 (0xac89 bytes) 2024-09-21T13:59:11.726 INFO:teuthology.orchestra.run.smithi079.stdout:2143 read 0x54eb978 thru 0x54f5ae6 (0xa16f bytes) 2024-09-21T13:59:11.748 INFO:teuthology.orchestra.run.smithi079.stdout:2144 write 0xede4b9a thru 0xede8ab8 (0x3f1f bytes) 2024-09-21T13:59:11.756 INFO:teuthology.orchestra.run.smithi079.stdout:2145 read 0x575b566 thru 0x57610b7 (0x5b52 bytes) 2024-09-21T13:59:11.757 INFO:teuthology.orchestra.run.smithi079.stdout:2146 write 0xbbf29fa thru 0xbbf94c2 (0x6ac9 bytes) 2024-09-21T13:59:11.760 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:11.760 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.765 INFO:teuthology.orchestra.run.smithi079.stdout:2148 writesame 0x2f4cff0 thru 0x2f58dd8 data_size 0x1(0xbde9 bytes) 2024-09-21T13:59:11.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:11.791 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:11.790+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:11.793 INFO:teuthology.orchestra.run.smithi079.stdout:2149 write 0x65b2b16 thru 0x65be5fb (0xbae6 bytes) 2024-09-21T13:59:11.796 INFO:teuthology.orchestra.run.smithi079.stdout:2150 write 0x24e527b thru 0x24ea4b1 (0x5237 bytes) 2024-09-21T13:59:11.804 INFO:teuthology.orchestra.run.smithi079.stdout:2151 write 0x117b710 thru 0x1189ac0 (0xe3b1 bytes) 2024-09-21T13:59:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:2152 read 0xa811384 thru 0xa81c32b (0xafa8 bytes) 2024-09-21T13:59:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:2153 write 0x9f4ce85 thru 0x9f4d2d7 (0x453 bytes) 2024-09-21T13:59:11.851 INFO:teuthology.orchestra.run.smithi079.stdout:2154 punch from 0xcf7ffde to 0xcf89e26, (0x9e48 bytes) 2024-09-21T13:59:11.851 INFO:teuthology.orchestra.run.smithi079.stdout:2155 writesame 0x90cb113 thru 0x90d472c data_size 0x1(0x961a bytes) 2024-09-21T13:59:11.892 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:11.889+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:11.893 INFO:teuthology.orchestra.run.smithi079.stdout:2157 read 0x5bd52f3 thru 0x5bdea6d (0x977b bytes) 2024-09-21T13:59:11.894 INFO:teuthology.orchestra.run.smithi079.stdout:2159 write 0xb7adbc thru 0xb7f222 (0x4467 bytes) 2024-09-21T13:59:11.918 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:11.918 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:11.920 INFO:teuthology.orchestra.run.smithi079.stdout:2160 write 0xd73ef59 thru 0xd74709e (0x8146 bytes) 2024-09-21T13:59:11.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:11.953 INFO:teuthology.orchestra.run.smithi079.stdout:2162 trunc from 0xede8ab9 to 0x5066400 2024-09-21T13:59:11.999 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:11.997+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:12.023 INFO:teuthology.orchestra.run.smithi079.stdout:2164 punch from 0x468b70a to 0x4695180, (0x9a76 bytes) 2024-09-21T13:59:12.023 INFO:teuthology.orchestra.run.smithi079.stdout:2165 punch from 0x2d9e477 to 0x2da07ba, (0x2343 bytes) 2024-09-21T13:59:12.024 INFO:teuthology.orchestra.run.smithi079.stdout:2166 writesame 0x4c11fc3 thru 0x4c12d87 data_size 0x5(0xdc5 bytes) 2024-09-21T13:59:12.025 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.056 INFO:teuthology.orchestra.run.smithi079.stdout:2170 write 0xea6404c thru 0xea679c1 (0x3976 bytes) 2024-09-21T13:59:12.062 INFO:teuthology.orchestra.run.smithi079.stdout:2171 read 0x445f6ea thru 0x446f551 (0xfe68 bytes) 2024-09-21T13:59:12.063 INFO:teuthology.orchestra.run.smithi079.stdout:2172 punch from 0xc074d2c to 0xc0843a3, (0xf677 bytes) 2024-09-21T13:59:12.063 INFO:teuthology.orchestra.run.smithi079.stdout:2173 read 0x211cf26 thru 0x21287e3 (0xb8be bytes) 2024-09-21T13:59:12.064 INFO:teuthology.orchestra.run.smithi079.stdout:2174 writesame 0x32aa2ba thru 0x32b03e3 data_size 0x1(0x612a bytes) 2024-09-21T13:59:12.090 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:12.090 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:12.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568235520999998, 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:12.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:12.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.095 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568123898, 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568104075000001, 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:12.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568079896, 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:12.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568055790999999, 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.115 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568037281999999, 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:12.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:12.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:12.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568027539999999, 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:12.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.568002680999999, 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.125 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:12.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567974004, 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:12.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:12.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:12.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567955185999999, 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:12.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:12.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:12.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567934515000001, 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:12.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:12.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567913443999998, 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.149 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567877591999999, 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567845370000001, 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:12.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:12.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.56780973, 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.163 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567775252000001, 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:12.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:12.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567720692000002, 2024-09-21T13:59:12.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:12.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567681527000001, 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:12.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:12.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:12.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567642791000001, 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:12.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.567618037999999, 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:12.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:12.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:12.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:12.187 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:12.188 INFO:teuthology.orchestra.run.smithi079.stdout:2175 write 0xd398e20 thru 0xd3a2c64 (0x9e45 bytes) 2024-09-21T13:59:12.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2176 write 0x6af8607 thru 0x6b01738 (0x9132 bytes) 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2177 trunc from 0xea679c2 to 0xbbeb710 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2178 punch from 0x33832aa to 0x3389d07, (0x6a5d bytes) 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2179 write 0x8f93e7 thru 0x90478a (0xb3a4 bytes) 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2180 write 0xb1780c7 thru 0xb17eafc (0x6a36 bytes) 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.190 INFO:teuthology.orchestra.run.smithi079.stdout:2183 read 0x148e26f thru 0x14950f9 (0x6e8b bytes) 2024-09-21T13:59:12.191 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.191 INFO:teuthology.orchestra.run.smithi079.stdout:2189 write 0xa95fbbb thru 0xa9621e6 (0x262c bytes) 2024-09-21T13:59:12.191 INFO:teuthology.orchestra.run.smithi079.stdout:2190 write 0x4d9a857 thru 0x4d9f401 (0x4bab bytes) 2024-09-21T13:59:12.191 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.191 INFO:teuthology.orchestra.run.smithi079.stdout:2192 writesame 0x446ead thru 0x447230 data_size 0xf(0x384 bytes) 2024-09-21T13:59:12.191 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:12.186+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:12.231 INFO:teuthology.orchestra.run.smithi079.stdout:2193 trunc from 0xbbeb710 to 0x6aac43f 2024-09-21T13:59:12.252 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.261 INFO:teuthology.orchestra.run.smithi079.stdout:2195 write 0x6cd76e6 thru 0x6ce7322 (0xfc3d bytes) 2024-09-21T13:59:12.285 INFO:teuthology.orchestra.run.smithi079.stdout:2196 write 0xa3f6d93 thru 0xa3fe293 (0x7501 bytes) 2024-09-21T13:59:12.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:12.285+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:12.295 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.295 INFO:teuthology.orchestra.run.smithi079.stdout:2198 read 0xa3bbae1 thru 0xa3c481f (0x8d3f bytes) 2024-09-21T13:59:12.296 INFO:teuthology.orchestra.run.smithi079.stdout:2199 punch from 0x1935b38 to 0x193709c, (0x1564 bytes) 2024-09-21T13:59:12.296 INFO:teuthology.orchestra.run.smithi079.stdout:2201 write 0x163e936 thru 0x164569b (0x6d66 bytes) 2024-09-21T13:59:12.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:2202 writesame 0xddb2fcb thru 0xddc2d0d data_size 0x1(0xfd43 bytes) 2024-09-21T13:59:12.316 INFO:teuthology.orchestra.run.smithi079.stdout:2203 read 0x8ed30be thru 0x8edb0e6 (0x8029 bytes) 2024-09-21T13:59:12.332 INFO:teuthology.orchestra.run.smithi079.stdout:2204 trunc from 0xddc2d0e to 0x3b054aa 2024-09-21T13:59:12.332 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:12.332 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:12.332 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:12.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:12.381 INFO:teuthology.orchestra.run.smithi079.stdout:2205 read 0x2da60bf thru 0x2dab47d (0x53bf bytes) 2024-09-21T13:59:12.382 INFO:teuthology.orchestra.run.smithi079.stdout:2207 punch from 0x588ba7 to 0x589b66, (0xfbf bytes) 2024-09-21T13:59:12.382 INFO:teuthology.orchestra.run.smithi079.stdout:2208 punch from 0xcc5db to 0xd3c01, (0x7626 bytes) 2024-09-21T13:59:12.382 INFO:teuthology.orchestra.run.smithi079.stdout:2210 read 0x3035058 thru 0x303b99a (0x6943 bytes) 2024-09-21T13:59:12.402 INFO:teuthology.orchestra.run.smithi079.stdout:2211 writesame 0xa7bde05 thru 0xa7c5b4b data_size 0x1(0x7d47 bytes) 2024-09-21T13:59:12.402 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.403 INFO:teuthology.orchestra.run.smithi079.stdout:2214 writesame 0x407d4f3 thru 0x4086f0a data_size 0x4(0x9a18 bytes) 2024-09-21T13:59:12.403 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:12.397+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:12.419 INFO:teuthology.orchestra.run.smithi079.stdout:2215 trunc from 0xa7c5b4c to 0x5de096b 2024-09-21T13:59:12.441 INFO:teuthology.orchestra.run.smithi079.stdout:2216 write 0x8ce5ccf thru 0x8cf3b9f (0xded1 bytes) 2024-09-21T13:59:12.450 INFO:teuthology.orchestra.run.smithi079.stdout:2217 read 0x70fd1c thru 0x71e6d4 (0xe9b9 bytes) 2024-09-21T13:59:12.451 INFO:teuthology.orchestra.run.smithi079.stdout:2218 writesame 0x365a927 thru 0x36684da data_size 0x2b(0xdbb4 bytes) 2024-09-21T13:59:12.461 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:12.461 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:12.479 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:12.480 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:12.483 INFO:teuthology.orchestra.run.smithi079.stdout:2219 write 0x5d5a647 thru 0x5d5da1c (0x33d6 bytes) 2024-09-21T13:59:12.491 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:12.490+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:12.497 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:12.497 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:12.504 INFO:teuthology.orchestra.run.smithi079.stdout:2220 write 0xe276970 thru 0xe283c60 (0xd2f1 bytes) 2024-09-21T13:59:12.514 INFO:teuthology.orchestra.run.smithi079.stdout:2223 punch from 0x31855cd to 0x3187ce3, (0x2716 bytes) 2024-09-21T13:59:12.514 INFO:teuthology.orchestra.run.smithi079.stdout:2224 writesame 0xd6dcc80 thru 0xd6e5f6e data_size 0x1(0x92ef bytes) 2024-09-21T13:59:12.516 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:12.516 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:12.517 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:12.517 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:12.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:12.535 INFO:teuthology.orchestra.run.smithi079.stdout:2226 read 0x9030ea2 thru 0x903aa0f (0x9b6e bytes) 2024-09-21T13:59:12.535 INFO:teuthology.orchestra.run.smithi079.stdout:2227 read 0xc1e51be thru 0xc1ee378 (0x91bb bytes) 2024-09-21T13:59:12.536 INFO:teuthology.orchestra.run.smithi079.stdout:2228 write 0xd669e3e thru 0xd679abe (0xfc81 bytes) 2024-09-21T13:59:12.543 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:12.543 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:12.544 INFO:teuthology.orchestra.run.smithi079.stdout:2229 read 0x4a32b6a thru 0x4a347ff (0x1c96 bytes) 2024-09-21T13:59:12.544 INFO:teuthology.orchestra.run.smithi079.stdout:2230 read 0xa4992e0 thru 0xa4a5318 (0xc039 bytes) 2024-09-21T13:59:12.544 INFO:teuthology.orchestra.run.smithi079.stdout:2233 writesame 0xcf03692 thru 0xcf12643 data_size 0x3f(0xefb2 bytes) 2024-09-21T13:59:12.555 INFO:teuthology.orchestra.run.smithi079.stdout:2235 writesame 0xb525a7e thru 0xb52665a data_size 0x1(0xbdd bytes) 2024-09-21T13:59:12.563 INFO:teuthology.orchestra.run.smithi079.stdout:2236 write 0x29c76f4 thru 0x29ca8e8 (0x31f5 bytes) 2024-09-21T13:59:12.566 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.566 INFO:teuthology.orchestra.run.smithi079.stdout:2239 punch from 0x921412f to 0x9223f94, (0xfe65 bytes) 2024-09-21T13:59:12.566 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:12.567 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:12.579 INFO:teuthology.orchestra.run.smithi079.stdout:2240 trunc from 0xe283c61 to 0x60b53fd 2024-09-21T13:59:12.591 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:12.592 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:12.590+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:12.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:12.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:12.600 INFO:teuthology.orchestra.run.smithi079.stdout:2241 read 0x5a77240 thru 0x5a7cded (0x5bae bytes) 2024-09-21T13:59:12.600 INFO:teuthology.orchestra.run.smithi079.stdout:2242 punch from 0x4436cf8 to 0x443a063, (0x336b bytes) 2024-09-21T13:59:12.600 INFO:teuthology.orchestra.run.smithi079.stdout:2243 read 0x10ae34c thru 0x10af7ad (0x1462 bytes) 2024-09-21T13:59:12.600 INFO:teuthology.orchestra.run.smithi079.stdout:2244 read 0x30feca5 thru 0x3100e8d (0x21e9 bytes) 2024-09-21T13:59:12.601 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.601 INFO:teuthology.orchestra.run.smithi079.stdout:2247 writesame 0x31bda9e thru 0x31c8d85 data_size 0x32(0xb2e8 bytes) 2024-09-21T13:59:12.605 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.605 INFO:teuthology.orchestra.run.smithi079.stdout:2250 write 0x22c6ee6 thru 0x22cd005 (0x6120 bytes) 2024-09-21T13:59:12.629 INFO:teuthology.orchestra.run.smithi079.stdout:2251 write 0xdf840ae thru 0xdf90124 (0xc077 bytes) 2024-09-21T13:59:12.639 INFO:teuthology.orchestra.run.smithi079.stdout:2253 read 0x60dd362 thru 0x60e2ac2 (0x5761 bytes) 2024-09-21T13:59:12.640 INFO:teuthology.orchestra.run.smithi079.stdout:2255 writesame 0xded7037 thru 0xdeda3e9 data_size 0x1(0x33b3 bytes) 2024-09-21T13:59:12.650 INFO:teuthology.orchestra.run.smithi079.stdout:2256 write 0x5a0900e thru 0x5a0f82a (0x681d bytes) 2024-09-21T13:59:12.674 INFO:teuthology.orchestra.run.smithi079.stdout:2258 trunc from 0xdf90125 to 0x347518b 2024-09-21T13:59:12.684 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:12.684 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:12.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:12.689+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:12.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:12.716 INFO:teuthology.orchestra.run.smithi079.stdout:2259 trunc from 0x347518b to 0xea48774 2024-09-21T13:59:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:2260 write 0x1661980 thru 0x1664d21 (0x33a2 bytes) 2024-09-21T13:59:12.739 INFO:teuthology.orchestra.run.smithi079.stdout:2261 read 0x97c148d thru 0x97cadff (0x9973 bytes) 2024-09-21T13:59:12.740 INFO:teuthology.orchestra.run.smithi079.stdout:2262 read 0x8ecee14 thru 0x8eda2a0 (0xb48d bytes) 2024-09-21T13:59:12.740 INFO:teuthology.orchestra.run.smithi079.stdout:2263 write 0x908a374 thru 0x9091530 (0x71bd bytes) 2024-09-21T13:59:12.746 INFO:teuthology.orchestra.run.smithi079.stdout:2265 write 0x12b9bab thru 0x12bbc60 (0x20b6 bytes) 2024-09-21T13:59:12.761 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:12.761 INFO:teuthology.orchestra.run.smithi079.stdout:2269 clone 19 order 23 su 32768 sc 13 2024-09-21T13:59:12.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:12.789+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:12.835 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:12.835 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:12.849 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:12.894 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:12.889+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:12.969 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:12.970 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:12.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:13.030 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:13.030+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:13.096 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:13.093+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:13.104 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:13.104 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:13.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:13.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:59:13.206 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:13.206+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:13.292 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:13.292 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:13.298 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:13.294+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:13.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:13.378 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone18 from 0xea48774 (overlap 0x347518b) to 0x2f362fd 2024-09-21T13:59:13.399 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:13.397+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:13.482 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:13.482 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:13.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:13.499 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:13.497+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:13.600 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:13.598+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:13.620 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:13.620 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:13.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:13.669 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-21T13:59:13.672 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:13.672 INFO:teuthology.orchestra.run.smithi079.stdout:2272 write 0x65fe6ee thru 0x65ff2c0 (0xbd3 bytes) 2024-09-21T13:59:13.720 INFO:teuthology.orchestra.run.smithi079.stdout:2274 write 0x2bb7b0e thru 0x2bc2c41 (0xb134 bytes) 2024-09-21T13:59:13.726 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:13.726+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:2278 read 0x938949e thru 0x93927c0 (0x9323 bytes) 2024-09-21T13:59:13.785 INFO:teuthology.orchestra.run.smithi079.stdout:2279 write 0x6d11cda thru 0x6d1209d (0x3c4 bytes) 2024-09-21T13:59:13.793 INFO:teuthology.orchestra.run.smithi079.stdout:2280 punch from 0xc882759 to 0xc88f4ca, (0xcd71 bytes) 2024-09-21T13:59:13.801 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:13.798+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:13.805 INFO:teuthology.orchestra.run.smithi079.stdout:2282 trunc from 0xea48774 to 0x95ecab6 2024-09-21T13:59:13.816 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:13.817 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:13.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:13.856 INFO:teuthology.orchestra.run.smithi079.stdout:2286 write 0x1a78a6f thru 0x1a7aec6 (0x2458 bytes) 2024-09-21T13:59:13.902 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:13.897+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:13.914 INFO:teuthology.orchestra.run.smithi079.stdout:2287 writesame 0x97a5bb5 thru 0x97b059a data_size 0x21(0xa9e6 bytes) 2024-09-21T13:59:13.916 INFO:teuthology.orchestra.run.smithi079.stdout:2288 read 0x7b8d51 thru 0x7bca31 (0x3ce1 bytes) 2024-09-21T13:59:13.933 INFO:teuthology.orchestra.run.smithi079.stdout:2290 write 0xc6a9b4b thru 0xc6ab7a0 (0x1c56 bytes) 2024-09-21T13:59:13.935 INFO:teuthology.orchestra.run.smithi079.stdout:2293 read 0xbdc2b97 thru 0xbdd17de (0xec48 bytes) 2024-09-21T13:59:13.936 INFO:teuthology.orchestra.run.smithi079.stdout:2294 write 0x953f9c9 thru 0x9549b58 (0xa190 bytes) 2024-09-21T13:59:13.939 INFO:teuthology.orchestra.run.smithi079.stdout:2295 punch from 0x65a72d0 to 0x65b35e2, (0xc312 bytes) 2024-09-21T13:59:13.939 INFO:teuthology.orchestra.run.smithi079.stdout:2296 write 0x3fa5272 thru 0x3fb364a (0xe3d9 bytes) 2024-09-21T13:59:13.990 INFO:teuthology.orchestra.run.smithi079.stdout:2297 write 0xcf0ffd9 thru 0xcf124cc (0x24f4 bytes) 2024-09-21T13:59:13.993 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:13.993 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:13.993 INFO:teuthology.orchestra.run.smithi079.stdout:2301 writesame 0x4d35748 thru 0x4d3b672 data_size 0x3(0x5f2b bytes) 2024-09-21T13:59:14.004 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:14.001+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:14.008 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:14.009 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:14.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:14.034 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:14.034 INFO:teuthology.orchestra.run.smithi079.stdout:2303 punch from 0x7d67f92 to 0x7d6c816, (0x4884 bytes) 2024-09-21T13:59:14.034 INFO:teuthology.orchestra.run.smithi079.stdout:2305 read 0x2d9fc96 thru 0x2da5613 (0x597e bytes) 2024-09-21T13:59:14.036 INFO:teuthology.orchestra.run.smithi079.stdout:2306 read 0x855a7b thru 0x859e98 (0x441e bytes) 2024-09-21T13:59:14.037 INFO:teuthology.orchestra.run.smithi079.stdout:2307 read 0x63e1058 thru 0x63e2210 (0x11b9 bytes) 2024-09-21T13:59:14.037 INFO:teuthology.orchestra.run.smithi079.stdout:2309 write 0x879975d thru 0x87a8c0c (0xf4b0 bytes) 2024-09-21T13:59:14.041 INFO:teuthology.orchestra.run.smithi079.stdout:2310 punch from 0x2df018c to 0x2df4ff7, (0x4e6b bytes) 2024-09-21T13:59:14.058 INFO:teuthology.orchestra.run.smithi079.stdout:2312 trunc from 0xcf124cd to 0x712fea0 2024-09-21T13:59:14.075 INFO:teuthology.orchestra.run.smithi079.stdout:2313 punch from 0x138031b to 0x1388d5e, (0x8a43 bytes) 2024-09-21T13:59:14.092 INFO:teuthology.orchestra.run.smithi079.stdout:2314 write 0x9401ca7 thru 0x940a61e (0x8978 bytes) 2024-09-21T13:59:14.096 INFO:teuthology.orchestra.run.smithi079.stdout:2315 read 0x773dff9 thru 0x7745fbb (0x7fc3 bytes) 2024-09-21T13:59:14.097 INFO:teuthology.orchestra.run.smithi079.stdout:2316 punch from 0x71d35fb to 0x71d6a02, (0x3407 bytes) 2024-09-21T13:59:14.110 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:14.109+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:14.123 INFO:teuthology.orchestra.run.smithi079.stdout:2317 writesame 0xdd9b275 thru 0xdda8b2f data_size 0x1(0xd8bb bytes) 2024-09-21T13:59:14.124 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:14.124 INFO:teuthology.orchestra.run.smithi079.stdout:2319 writesame 0x2df062b thru 0x2df7e9d data_size 0x7(0x7873 bytes) 2024-09-21T13:59:14.131 INFO:teuthology.orchestra.run.smithi079.stdout:2321 punch from 0xbc03bea to 0xbc0eb1f, (0xaf35 bytes) 2024-09-21T13:59:14.131 INFO:teuthology.orchestra.run.smithi079.stdout:2323 write 0xd8584de thru 0xd863f80 (0xbaa3 bytes) 2024-09-21T13:59:14.140 INFO:teuthology.orchestra.run.smithi079.stdout:2324 clone 20 order 20 su 65536 sc 4 2024-09-21T13:59:14.191 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:14.191 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:14.191 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:59:14.203 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:14.201+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:14.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:14.304 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:14.301+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:14.326 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:14.326 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:14.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:14.405 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:14.401+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:14.413 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone19 from 0xdda8b30 (overlap 0x712fea0) to 0xb51976 2024-09-21T13:59:14.506 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:14.501+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:14.528 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:14.528 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:14.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:14.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:14.606 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:14.605+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:14.707 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:14.701+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:14.724 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:14.724 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:14.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:14.785 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:14.786 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:14.806 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:14.807 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:14.807 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:14.805+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:14.820 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-21T13:59:14.824 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:14.824 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:14.842 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:14.843 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:14.876 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:14.876 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:14.897 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:14.909 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:14.905+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:14.917 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:14.918 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:14.918 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:14.920 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:14.920 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:14.920 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:14.920 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:14.921 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:14.921 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:14.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:14.941 INFO:teuthology.orchestra.run.smithi079.stdout:2326 trunc from 0xdda8b30 to 0x79eec0d 2024-09-21T13:59:14.980 INFO:teuthology.orchestra.run.smithi079.stdout:2329 read 0x13347ae thru 0x133821d (0x3a70 bytes) 2024-09-21T13:59:14.981 INFO:teuthology.orchestra.run.smithi079.stdout:2330 punch from 0x3a58120 to 0x3a65a7e, (0xd95e bytes) 2024-09-21T13:59:14.981 INFO:teuthology.orchestra.run.smithi079.stdout:2331 read 0x31b2c44 thru 0x31b631b (0x36d8 bytes) 2024-09-21T13:59:14.982 INFO:teuthology.orchestra.run.smithi079.stdout:2332 writesame 0x160b130 thru 0x16194bf data_size 0x10(0xe390 bytes) 2024-09-21T13:59:15.001 INFO:teuthology.orchestra.run.smithi079.stdout:2335 punch from 0x24e4e57 to 0x24edaaf, (0x8c58 bytes) 2024-09-21T13:59:15.002 INFO:teuthology.orchestra.run.smithi079.stdout:2337 punch from 0x689213a to 0x689d313, (0xb1d9 bytes) 2024-09-21T13:59:15.002 INFO:teuthology.orchestra.run.smithi079.stdout:2338 read 0x4da992c thru 0x4db4557 (0xac2c bytes) 2024-09-21T13:59:15.002 INFO:teuthology.orchestra.run.smithi079.stdout:2339 write 0x2c455a0 thru 0x2c4f960 (0xa3c1 bytes) 2024-09-21T13:59:15.009 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:15.005+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:15.034 INFO:teuthology.orchestra.run.smithi079.stdout:2341 write 0xbbfbc89 thru 0xbc0448c (0x8804 bytes) 2024-09-21T13:59:15.041 INFO:teuthology.orchestra.run.smithi079.stdout:2342 read 0x9ab8f66 thru 0x9ac53f4 (0xc48f bytes) 2024-09-21T13:59:15.041 INFO:teuthology.orchestra.run.smithi079.stdout:2344 writesame 0x4660887 thru 0x4669535 data_size 0x69(0x8caf bytes) 2024-09-21T13:59:15.052 INFO:teuthology.orchestra.run.smithi079.stdout:2345 punch from 0x6fd1bf2 to 0x6fd8fbc, (0x73ca bytes) 2024-09-21T13:59:15.052 INFO:teuthology.orchestra.run.smithi079.stdout:2346 write 0x68a97db thru 0x68b111a (0x7940 bytes) 2024-09-21T13:59:15.065 INFO:teuthology.orchestra.run.smithi079.stdout:2347 read 0x4b7f58a thru 0x4b7f947 (0x3be bytes) 2024-09-21T13:59:15.068 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:15.068 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:15.085 INFO:teuthology.orchestra.run.smithi079.stdout:2348 trunc from 0xbc0448d to 0x1fc28f4 2024-09-21T13:59:15.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:15.110 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:15.109+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:15.168 INFO:teuthology.orchestra.run.smithi079.stdout:2349 writesame 0xe64d629 thru 0xe65af4b data_size 0x7(0xd923 bytes) 2024-09-21T13:59:15.168 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:15.183 INFO:teuthology.orchestra.run.smithi079.stdout:2353 trunc from 0xe65af4c to 0x72c530a 2024-09-21T13:59:15.211 INFO:teuthology.orchestra.run.smithi079.stdout:2354 trunc from 0x72c530a to 0x113b486 2024-09-21T13:59:15.211 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:15.209+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:15.270 INFO:teuthology.orchestra.run.smithi079.stdout:2355 write 0x122bdbc thru 0x1234261 (0x84a6 bytes) 2024-09-21T13:59:15.277 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:15.277 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:15.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.439739226999997, 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:15.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:15.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.299715786999997, 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:15.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.289 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.271456782000001, 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:15.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:15.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.293 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.374348237, 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.374286767999997, 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:15.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:15.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:15.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.366116018, 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:59:15.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365222793000001, 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:15.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365165032999997, 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:15.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365146441, 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365134103000003, 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:15.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365112367000002, 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365089183999999, 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365068755000003, 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365053957000001, 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365029372999999, 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.365012677000003, 2024-09-21T13:59:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.36499044, 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.446702137000003, 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.277183589000003, 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.913944995000001, 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.384 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:15.384 INFO:teuthology.orchestra.run.smithi079.stdout:2356 trunc from 0x1234262 to 0x3f791fa 2024-09-21T13:59:15.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2359 read 0x11e95e6 thru 0x11ee5b9 (0x4fd4 bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2360 writesame 0x810532 thru 0x8188b8 data_size 0x1(0x8387 bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2363 punch from 0x4376a1 to 0x44468a, (0xcfe9 bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2364 write 0x6c79cac thru 0x6c7aee8 (0x123d bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2365 punch from 0x2dc8115 to 0x2dc99de, (0x18c9 bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2366 punch from 0x2786f27 to 0x279555d, (0xe636 bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2367 read 0x3d6a967 thru 0x3d755d3 (0xac6d bytes) 2024-09-21T13:59:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:2368 write 0x22fdc62 thru 0x230709e (0x943d bytes) 2024-09-21T13:59:15.400 INFO:teuthology.orchestra.run.smithi079.stdout:2369 trunc from 0x6c7aee9 to 0xd5b93b0 2024-09-21T13:59:15.401 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:15.397+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:15.413 INFO:teuthology.orchestra.run.smithi079.stdout:2371 punch from 0x42125f6 to 0x421b1b9, (0x8bc3 bytes) 2024-09-21T13:59:15.413 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:15.413 INFO:teuthology.orchestra.run.smithi079.stdout:2373 read 0xb4b1316 thru 0xb4ba550 (0x923b bytes) 2024-09-21T13:59:15.417 INFO:teuthology.orchestra.run.smithi079.stdout:2374 trunc from 0xd5b93b0 to 0xaa42043 2024-09-21T13:59:15.430 INFO:teuthology.orchestra.run.smithi079.stdout:2376 read 0x77fa23f thru 0x7808c8e (0xea50 bytes) 2024-09-21T13:59:15.430 INFO:teuthology.orchestra.run.smithi079.stdout:2377 punch from 0x194b7b8 to 0x194f7ae, (0x3ff6 bytes) 2024-09-21T13:59:15.439 INFO:teuthology.orchestra.run.smithi079.stdout:2378 trunc from 0xaa42043 to 0x5dc9635 2024-09-21T13:59:15.481 INFO:teuthology.orchestra.run.smithi079.stdout:2380 write 0x9ec50ad thru 0x9ecdaca (0x8a1e bytes) 2024-09-21T13:59:15.488 INFO:teuthology.orchestra.run.smithi079.stdout:2381 read 0x80e21e7 thru 0x80ee361 (0xc17b bytes) 2024-09-21T13:59:15.488 INFO:teuthology.orchestra.run.smithi079.stdout:2383 punch from 0x6837be0 to 0x683d6a6, (0x5ac6 bytes) 2024-09-21T13:59:15.488 INFO:teuthology.orchestra.run.smithi079.stdout:2385 write 0x2db74d3 thru 0x2dba91a (0x3448 bytes) 2024-09-21T13:59:15.489 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:15.485+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:15.494 INFO:teuthology.orchestra.run.smithi079.stdout:2386 read 0x9bcda76 thru 0x9bd86e7 (0xac72 bytes) 2024-09-21T13:59:15.495 INFO:teuthology.orchestra.run.smithi079.stdout:2387 writesame 0x30fad02 thru 0x31066ad data_size 0x66(0xb9ac bytes) 2024-09-21T13:59:15.502 INFO:teuthology.orchestra.run.smithi079.stdout:2388 write 0x36f5615 thru 0x36ff7ad (0xa199 bytes) 2024-09-21T13:59:15.510 INFO:teuthology.orchestra.run.smithi079.stdout:2389 read 0x65b357f thru 0x65bc177 (0x8bf9 bytes) 2024-09-21T13:59:15.530 INFO:teuthology.orchestra.run.smithi079.stdout:2390 write 0xec88699 thru 0xec968d7 (0xe23f bytes) 2024-09-21T13:59:15.531 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:15.531 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:15.531 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:15.531 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:15.540 INFO:teuthology.orchestra.run.smithi079.stdout:2391 read 0x845f838 thru 0x8467672 (0x7e3b bytes) 2024-09-21T13:59:15.540 INFO:teuthology.orchestra.run.smithi079.stdout:2393 punch from 0x2442253 to 0x244367e, (0x142b bytes) 2024-09-21T13:59:15.541 INFO:teuthology.orchestra.run.smithi079.stdout:2394 write 0x9fa34f5 thru 0x9fa90b2 (0x5bbe bytes) 2024-09-21T13:59:15.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:15.547 INFO:teuthology.orchestra.run.smithi079.stdout:2395 writesame 0x707f004 thru 0x708d79c data_size 0x1(0xe799 bytes) 2024-09-21T13:59:15.595 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:15.593+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:15.631 INFO:teuthology.orchestra.run.smithi079.stdout:2397 trunc from 0xec968d8 to 0x47f9db6 2024-09-21T13:59:15.653 INFO:teuthology.orchestra.run.smithi079.stdout:2398 read 0x53e125 thru 0x542ada (0x49b6 bytes) 2024-09-21T13:59:15.672 INFO:teuthology.orchestra.run.smithi079.stdout:2399 write 0x7d355a8 thru 0x7d3910d (0x3b66 bytes) 2024-09-21T13:59:15.680 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:15.680 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:15.690 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:15.689+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:15.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:15.700 INFO:teuthology.orchestra.run.smithi079.stdout:2401 write 0xcc97818 thru 0xcca690b (0xf0f4 bytes) 2024-09-21T13:59:15.720 INFO:teuthology.orchestra.run.smithi079.stdout:2403 trunc from 0xcca690c to 0x56f4356 2024-09-21T13:59:15.743 INFO:teuthology.orchestra.run.smithi079.stdout:2404 punch from 0x1719c29 to 0x171f88e, (0x5c65 bytes) 2024-09-21T13:59:15.743 INFO:teuthology.orchestra.run.smithi079.stdout:2405 write 0x1bed331 thru 0x1bf1e26 (0x4af6 bytes) 2024-09-21T13:59:15.751 INFO:teuthology.orchestra.run.smithi079.stdout:2406 punch from 0x3e37a86 to 0x3e46e62, (0xf3dc bytes) 2024-09-21T13:59:15.759 INFO:teuthology.orchestra.run.smithi079.stdout:2407 trunc from 0x56f4356 to 0xa4b600e 2024-09-21T13:59:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:2409 punch from 0x3ded0b7 to 0x3def702, (0x264b bytes) 2024-09-21T13:59:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:2412 punch from 0x6320201 to 0x6326753, (0x6552 bytes) 2024-09-21T13:59:15.772 INFO:teuthology.orchestra.run.smithi079.stdout:2414 writesame 0x8f87560 thru 0x8f95b1e data_size 0xf(0xe5bf bytes) 2024-09-21T13:59:15.780 INFO:teuthology.orchestra.run.smithi079.stdout:2418 writesame 0x121cf9f thru 0x1227114 data_size 0x6(0xa176 bytes) 2024-09-21T13:59:15.788 INFO:teuthology.orchestra.run.smithi079.stdout:2420 read 0x287c9bc thru 0x288054a (0x3b8f bytes) 2024-09-21T13:59:15.788 INFO:teuthology.orchestra.run.smithi079.stdout:2421 read 0x18e2ff6 thru 0x18e8069 (0x5074 bytes) 2024-09-21T13:59:15.789 INFO:teuthology.orchestra.run.smithi079.stdout:2422 read 0x35f51a2 thru 0x3603c4a (0xeaa9 bytes) 2024-09-21T13:59:15.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:15.785+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:15.801 INFO:teuthology.orchestra.run.smithi079.stdout:2423 trunc from 0xa4b600e to 0x3746449 2024-09-21T13:59:15.826 INFO:teuthology.orchestra.run.smithi079.stdout:2424 read 0xf84da1 thru 0xf8e43d (0x969d bytes) 2024-09-21T13:59:15.828 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:15.828 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306804941000003, 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.829 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:15.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:15.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.834 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306693318000001, 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:15.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:15.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.839 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306673494999998, 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:15.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:15.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:15.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306649315999998, 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:15.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306625210999997, 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:15.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:15.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306606702000003, 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:15.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.862 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.30659696, 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:15.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:15.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:15.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306572101, 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:15.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.875 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306543423999997, 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:15.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:15.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306524605999996, 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:15.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:15.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306503935000002, 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:15.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306482864000003, 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:15.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:15.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306447012, 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:15.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306414789999998, 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:15.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:15.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306379149999998, 2024-09-21T13:59:15.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:15.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306344672000002, 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:15.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:15.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306290111999999, 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:15.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:15.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:15.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306250947000002, 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:15.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:15.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306212211000002, 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:15.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:15.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.306187457999997, 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:15.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:15.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:15.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:15.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:15.938 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:15.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:15.940 INFO:teuthology.orchestra.run.smithi079.stdout:2426 writesame 0xe784fc8 thru 0xe785f81 data_size 0x21(0xfba bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2427 punch from 0x75c8756 to 0x75d3f06, (0xb7b0 bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2428 punch from 0x4943ff1 to 0x4944e03, (0xe12 bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2430 write 0x98201e4 thru 0x982c03e (0xbe5b bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2431 read 0xaec9ff thru 0xaeca51 (0x53 bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2432 punch from 0xbbf37f3 to 0xbbfdd70, (0xa57d bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2435 write 0xa1b4f0c thru 0xa1c2a0f (0xdb04 bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2438 writesame 0x8e8b462 thru 0x8e994bb data_size 0x2f(0xe05a bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2439 write 0x7f0a503 thru 0x7f0f0b0 (0x4bae bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2440 write 0xe5f069c thru 0xe5f2ddd (0x2742 bytes) 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:15.941 INFO:teuthology.orchestra.run.smithi079.stdout:2442 write 0xcec8acd thru 0xced00cd (0x7601 bytes) 2024-09-21T13:59:15.942 INFO:teuthology.orchestra.run.smithi079.stdout:2443 read 0x8e442bb thru 0x8e47534 (0x327a bytes) 2024-09-21T13:59:15.942 INFO:teuthology.orchestra.run.smithi079.stdout:2444 punch from 0x1f21a0e to 0x1f25a31, (0x4023 bytes) 2024-09-21T13:59:15.942 INFO:teuthology.orchestra.run.smithi079.stdout:2445 trunc from 0xe785f82 to 0x90986fb 2024-09-21T13:59:15.942 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:15.933+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:15.943 INFO:teuthology.orchestra.run.smithi079.stdout:2446 punch from 0x1502b92 to 0x1504c19, (0x2087 bytes) 2024-09-21T13:59:15.943 INFO:teuthology.orchestra.run.smithi079.stdout:2448 punch from 0x402fe1c to 0x403cfcc, (0xd1b0 bytes) 2024-09-21T13:59:15.943 INFO:teuthology.orchestra.run.smithi079.stdout:2449 read 0x688ce30 thru 0x6897c79 (0xae4a bytes) 2024-09-21T13:59:15.943 INFO:teuthology.orchestra.run.smithi079.stdout:2451 write 0x7610e24 thru 0x761141b (0x5f8 bytes) 2024-09-21T13:59:15.948 INFO:teuthology.orchestra.run.smithi079.stdout:2452 punch from 0xbb867e to 0xbc5d0a, (0xd68c bytes) 2024-09-21T13:59:15.972 INFO:teuthology.orchestra.run.smithi079.stdout:2453 write 0xd71b0c2 thru 0xd71b111 (0x50 bytes) 2024-09-21T13:59:15.977 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:15.977 INFO:teuthology.orchestra.run.smithi079.stdout:2455 punch from 0xb2d705 to 0xb2f08e, (0x1989 bytes) 2024-09-21T13:59:15.978 INFO:teuthology.orchestra.run.smithi079.stdout:2458 writesame 0x8d14d95 thru 0x8d1d067 data_size 0x1(0x82d3 bytes) 2024-09-21T13:59:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:2459 read 0x1698969 thru 0x16a0a2a (0x80c2 bytes) 2024-09-21T13:59:16.023 INFO:teuthology.orchestra.run.smithi079.stdout:2460 read 0x750b38e thru 0x7518e89 (0xdafc bytes) 2024-09-21T13:59:16.024 INFO:teuthology.orchestra.run.smithi079.stdout:2461 writesame 0x48527e thru 0x487c3e data_size 0x7(0x29c1 bytes) 2024-09-21T13:59:16.039 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:16.037+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:16.040 INFO:teuthology.orchestra.run.smithi079.stdout:2462 punch from 0x314334d to 0x31446ad, (0x1360 bytes) 2024-09-21T13:59:16.041 INFO:teuthology.orchestra.run.smithi079.stdout:2463 read 0x6855efa thru 0x685e877 (0x897e bytes) 2024-09-21T13:59:16.041 INFO:teuthology.orchestra.run.smithi079.stdout:2465 read 0xd6009e6 thru 0xd609b79 (0x9194 bytes) 2024-09-21T13:59:16.041 INFO:teuthology.orchestra.run.smithi079.stdout:2466 read 0x75e9679 thru 0x75f0c2e (0x75b6 bytes) 2024-09-21T13:59:16.041 INFO:teuthology.orchestra.run.smithi079.stdout:2467 read 0xd4ad853 thru 0xd4b24e6 (0x4c94 bytes) 2024-09-21T13:59:16.044 INFO:teuthology.orchestra.run.smithi079.stdout:2468 trunc from 0xd71b112 to 0xc2adba3 2024-09-21T13:59:16.068 INFO:teuthology.orchestra.run.smithi079.stdout:2471 read 0xaa4b282 thru 0xaa4d51f (0x229e bytes) 2024-09-21T13:59:16.070 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:16.071 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:16.088 INFO:teuthology.orchestra.run.smithi079.stdout:2475 trunc from 0xc2adba3 to 0x2deaa50 2024-09-21T13:59:16.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:16.142 INFO:teuthology.orchestra.run.smithi079.stdout:2476 write 0xa7226fc thru 0xa72db40 (0xb445 bytes) 2024-09-21T13:59:16.142 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:16.137+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:16.163 INFO:teuthology.orchestra.run.smithi079.stdout:2477 write 0xc3e9c00 thru 0xc3f22c9 (0x86ca bytes) 2024-09-21T13:59:16.174 INFO:teuthology.orchestra.run.smithi079.stdout:2478 trunc from 0xc3f22ca to 0xd8890d7 2024-09-21T13:59:16.185 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.185 INFO:teuthology.orchestra.run.smithi079.stdout:2482 write 0xd67e982 thru 0xd685a47 (0x70c6 bytes) 2024-09-21T13:59:16.194 INFO:teuthology.orchestra.run.smithi079.stdout:2483 write 0x67fa3b9 thru 0x6804fb9 (0xac01 bytes) 2024-09-21T13:59:16.203 INFO:teuthology.orchestra.run.smithi079.stdout:2484 read 0x91e9f60 thru 0x91eab0c (0xbad bytes) 2024-09-21T13:59:16.204 INFO:teuthology.orchestra.run.smithi079.stdout:2486 punch from 0xa6253e2 to 0xa62a8c2, (0x54e0 bytes) 2024-09-21T13:59:16.204 INFO:teuthology.orchestra.run.smithi079.stdout:2488 writesame 0xbedb8fe thru 0xbedcb8f data_size 0x1(0x1292 bytes) 2024-09-21T13:59:16.211 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.211 INFO:teuthology.orchestra.run.smithi079.stdout:2490 read 0x1e5d5e2 thru 0x1e60fa0 (0x39bf bytes) 2024-09-21T13:59:16.211 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.211 INFO:teuthology.orchestra.run.smithi079.stdout:2493 write 0xb9c4d3b thru 0xb9c54b6 (0x77c bytes) 2024-09-21T13:59:16.217 INFO:teuthology.orchestra.run.smithi079.stdout:2496 read 0x7737d05 thru 0x7741079 (0x9375 bytes) 2024-09-21T13:59:16.217 INFO:teuthology.orchestra.run.smithi079.stdout:2497 punch from 0x57f5ed4 to 0x57ffb20, (0x9c4c bytes) 2024-09-21T13:59:16.217 INFO:teuthology.orchestra.run.smithi079.stdout:2499 read 0xc4150ed thru 0xc42488a (0xf79e bytes) 2024-09-21T13:59:16.217 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:59:16.228 INFO:teuthology.orchestra.run.smithi079.stdout:2501 write 0xdce3b11 thru 0xdce3eb0 (0x3a0 bytes) 2024-09-21T13:59:16.234 INFO:teuthology.orchestra.run.smithi079.stdout:2502 read 0x9bcf1a0 thru 0x9bd000b (0xe6c bytes) 2024-09-21T13:59:16.234 INFO:teuthology.orchestra.run.smithi079.stdout:2503 write 0xcb241a thru 0xcb6ce5 (0x48cc bytes) 2024-09-21T13:59:16.241 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:16.237+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:16.247 INFO:teuthology.orchestra.run.smithi079.stdout:2504 write 0x2b9179d thru 0x2ba0ded (0xf651 bytes) 2024-09-21T13:59:16.256 INFO:teuthology.orchestra.run.smithi079.stdout:2505 writesame 0x98d46ec thru 0x98dba28 data_size 0x1(0x733d bytes) 2024-09-21T13:59:16.260 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:16.261 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:16.261 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:16.261 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:16.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:16.297 INFO:teuthology.orchestra.run.smithi079.stdout:2506 write 0x2bbf3d3 thru 0x2bc2cc1 (0x38ef bytes) 2024-09-21T13:59:16.306 INFO:teuthology.orchestra.run.smithi079.stdout:2507 punch from 0xa59f46b to 0xa5aac1b, (0xb7b0 bytes) 2024-09-21T13:59:16.306 INFO:teuthology.orchestra.run.smithi079.stdout:2509 write 0xbd5d4cb thru 0xbd63b72 (0x66a8 bytes) 2024-09-21T13:59:16.313 INFO:teuthology.orchestra.run.smithi079.stdout:2510 write 0x56839fb thru 0x568881f (0x4e25 bytes) 2024-09-21T13:59:16.319 INFO:teuthology.orchestra.run.smithi079.stdout:2511 read 0xecf606 thru 0xeddab9 (0xe4b4 bytes) 2024-09-21T13:59:16.320 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.320 INFO:teuthology.orchestra.run.smithi079.stdout:2513 punch from 0x41ecbaa to 0x41f77fb, (0xac51 bytes) 2024-09-21T13:59:16.321 INFO:teuthology.orchestra.run.smithi079.stdout:2514 write 0x5d53b45 thru 0x5d5ca76 (0x8f32 bytes) 2024-09-21T13:59:16.342 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:16.337+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:16.344 INFO:teuthology.orchestra.run.smithi079.stdout:2515 trunc from 0xdce3eb1 to 0x1ee1eb9 2024-09-21T13:59:16.374 INFO:teuthology.orchestra.run.smithi079.stdout:2516 trunc from 0x1ee1eb9 to 0x3821597 2024-09-21T13:59:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:2517 writesame 0xc08be74 thru 0xc09695f data_size 0x2(0xaaec bytes) 2024-09-21T13:59:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:2518 punch from 0x4239759 to 0x423dff1, (0x4898 bytes) 2024-09-21T13:59:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:2519 read 0x46a286e thru 0x46a7e09 (0x559c bytes) 2024-09-21T13:59:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.415 INFO:teuthology.orchestra.run.smithi079.stdout:2521 read 0x21cd652 thru 0x21cec4d (0x15fc bytes) 2024-09-21T13:59:16.416 INFO:teuthology.orchestra.run.smithi079.stdout:2522 read 0x6b6c8af thru 0x6b6ffc0 (0x3712 bytes) 2024-09-21T13:59:16.431 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:16.431 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.027881309000001, 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:16.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:16.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.987794471000001, 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:16.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.926481215000003, 2024-09-21T13:59:16.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:16.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:16.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133358 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 76800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:16.447 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.61827652, 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058918719000000001, 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133358 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811181+0000", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811185+0000", 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-21T13:59:16.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811193+0000", 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1289999999999996e-06 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811200+0000", 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7129999999999999e-06 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869833+0000", 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058633115999999999 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869948+0000", 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115584 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870101+0000", 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152287 2024-09-21T13:59:16.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133359 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618253052, 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059286298000000001, 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133359 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811205+0000", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811208+0000", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2729999999999998e-06 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811216+0000", 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.259e-06 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811223+0000", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6259999999999997e-06 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870168+0000", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058945164000000001 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870311+0000", 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142464 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870492+0000", 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181118 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133360 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 87040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618229916000001, 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059596781000000001, 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.456 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133360 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811228+0000", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811231+0000", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.196e-06 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811239+0000", 2024-09-21T13:59:16.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811246+0000", 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6100000000000002e-06 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870555+0000", 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059309029999999999 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870673+0000", 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118363 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870825+0000", 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015213600000000001 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133361 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 92160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618207075000001, 2024-09-21T13:59:16.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059958546000000001, 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133361 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811254+0000", 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.337e-06 2024-09-21T13:59:16.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811262+0000", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1659999999999994e-06 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811269+0000", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5930000000000002e-06 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870893+0000", 2024-09-21T13:59:16.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059623968999999999 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871028+0000", 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135501 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871210+0000", 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018161699999999999 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133362 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 97280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618183742999999, 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060278945, 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133362 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811274+0000", 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811277+0000", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000001e-06 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811285+0000", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9119999999999998e-06 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811292+0000", 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6200000000000001e-06 2024-09-21T13:59:16.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871273+0000", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059980588000000001 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871400+0000", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127525 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871554+0000", 2024-09-21T13:59:16.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015371300000000001 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133363 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 103424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618146176, 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060623992000000002, 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133363 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811315+0000", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3529999999999999e-06 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811324+0000", 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5089999999999993e-06 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811330+0000", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871620+0000", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060289397000000002 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871753+0000", 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132908 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871936+0000", 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000183881 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133364 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618122614000001, 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060935982, 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133364 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:16.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811335+0000", 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811339+0000", 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2229999999999999e-06 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811347+0000", 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2730000000000002e-06 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811353+0000", 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5989999999999998e-06 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871999+0000", 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060645731000000001 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872119+0000", 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119867 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872272+0000", 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015293199999999999 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133365 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 113664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618099388999999, 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.06130443, 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133365 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:16.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811362+0000", 2024-09-21T13:59:16.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2160000000000002e-06 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811370+0000", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811376+0000", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3799999999999999e-06 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872342+0000", 2024-09-21T13:59:16.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060965424999999997 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872482+0000", 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014024400000000001 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872664+0000", 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018166499999999999 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133366 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 118784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618076459999999, 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061625971000000002, 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133366 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811385+0000", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.332e-06 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811393+0000", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170000000000004e-06 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811400+0000", 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6889999999999998e-06 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872726+0000", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061325932999999999 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872856+0000", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130588 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873008+0000", 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000151905 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133367 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 123904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618053262, 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061995883000000002, 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133367 2024-09-21T13:59:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811408+0000", 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.14e-06 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811416+0000", 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0490000000000004e-06 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811422+0000", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873082+0000", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061659985 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873224+0000", 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014196400000000001 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873401+0000", 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017682099999999999 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133368 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 129024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.618030547, 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062336753000000002, 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133368 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811427+0000", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811454+0000", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6825000000000002e-05 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811464+0000", 2024-09-21T13:59:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5990000000000008e-06 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811471+0000", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873463+0000", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061991549 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873609+0000", 2024-09-21T13:59:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014674999999999999 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873765+0000", 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155456 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133369 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 135168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.617981313, 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062595426999999995, 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133369 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811480+0000", 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.18e-06 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811488+0000", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811495+0000", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.686e-06 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873807+0000", 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062312233000000002 2024-09-21T13:59:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873921+0000", 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113486 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874073+0000", 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152156 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133370 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 140288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.617958008, 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063038644000000005, 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133370 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811500+0000", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811503+0000", 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5020000000000001e-06 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811512+0000", 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811518+0000", 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7660000000000001e-06 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874173+0000", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062654177000000005 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874335+0000", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016219499999999999 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874539+0000", 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133371 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 145408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.61793462, 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0633967, 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133371 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811523+0000", 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811527+0000", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811535+0000", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811542+0000", 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:59:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874635+0000", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063093623000000001 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874762+0000", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012691199999999999 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874921+0000", 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848899999999999 2024-09-21T13:59:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133372 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 150528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.617911300999999, 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063676675000000002, 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133372 2024-09-21T13:59:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811550+0000", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1889999999999999e-06 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811558+0000", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1769999999999998e-06 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811565+0000", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874963+0000", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063398191000000007 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875075+0000", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011169499999999999 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875224+0000", 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014938700000000001 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133373 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.617886123, 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064102759999999995, 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133373 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811575+0000", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811583+0000", 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4090000000000003e-06 2024-09-21T13:59:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811590+0000", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0559999999999999e-06 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875318+0000", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063727151999999995 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875477+0000", 2024-09-21T13:59:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015933500000000001 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875675+0000", 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019835400000000001 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133374 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 160768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.617859430999999, 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064394145999999999, 2024-09-21T13:59:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133374 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811598+0000", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811603+0000", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2499999999999997e-06 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811619+0000", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5736e-05 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811633+0000", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3862e-05 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875721+0000", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064088110000000004 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875838+0000", 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116801 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875993+0000", 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015558400000000001 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.519 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:16.520 INFO:teuthology.orchestra.run.smithi079.stdout:2523 trunc from 0xc096960 to 0xbe15b8 2024-09-21T13:59:16.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:16.521 INFO:teuthology.orchestra.run.smithi079.stdout:2524 trunc from 0xbe15b8 to 0x47bc4ad 2024-09-21T13:59:16.522 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:16.517+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:16.526 INFO:teuthology.orchestra.run.smithi079.stdout:2525 write 0xcbf1960 thru 0xcbf292e (0xfcf bytes) 2024-09-21T13:59:16.534 INFO:teuthology.orchestra.run.smithi079.stdout:2526 write 0x7cbcb7d thru 0x7cbd445 (0x8c9 bytes) 2024-09-21T13:59:16.539 INFO:teuthology.orchestra.run.smithi079.stdout:2527 write 0x350e24b thru 0x351b957 (0xd70d bytes) 2024-09-21T13:59:16.544 INFO:teuthology.orchestra.run.smithi079.stdout:2528 read 0x3b30f67 thru 0x3b39703 (0x879d bytes) 2024-09-21T13:59:16.544 INFO:teuthology.orchestra.run.smithi079.stdout:2529 writesame 0x44c34f2 thru 0x44cceb1 data_size 0x52(0x99c0 bytes) 2024-09-21T13:59:16.548 INFO:teuthology.orchestra.run.smithi079.stdout:2532 read 0x6af5b4f thru 0x6af9a8c (0x3f3e bytes) 2024-09-21T13:59:16.548 INFO:teuthology.orchestra.run.smithi079.stdout:2533 write 0x220a453 thru 0x2217e0c (0xd9ba bytes) 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:2538 read 0xbbd4cde thru 0xbbe233f (0xd662 bytes) 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:2539 read 0x757cae9 thru 0x757ea17 (0x1f2f bytes) 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:2543 read 0x8ca7949 thru 0x8cb768f (0xfd47 bytes) 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:2545 read 0x14bf851 thru 0x14c4b7b (0x532b bytes) 2024-09-21T13:59:16.555 INFO:teuthology.orchestra.run.smithi079.stdout:2546 write 0x13bf817 thru 0x13c84c8 (0x8cb2 bytes) 2024-09-21T13:59:16.578 INFO:teuthology.orchestra.run.smithi079.stdout:2548 trunc from 0xcbf292f to 0x1fb15bd 2024-09-21T13:59:16.596 INFO:teuthology.orchestra.run.smithi079.stdout:2549 punch from 0x1c344e1 to 0x1c3f4dd, (0xaffc bytes) 2024-09-21T13:59:16.596 INFO:teuthology.orchestra.run.smithi079.stdout:2550 read 0x1ee3405 thru 0x1eebd3b (0x8937 bytes) 2024-09-21T13:59:16.602 INFO:teuthology.orchestra.run.smithi079.stdout:2552 trunc from 0x1fb15bd to 0x5af1a4b 2024-09-21T13:59:16.604 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:16.604 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:16.604 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T13:59:16.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T13:59:16.613 INFO:teuthology.orchestra.run.smithi079.stdout:2553 writesame 0x453b23 thru 0x461b45 data_size 0x7(0xe023 bytes) 2024-09-21T13:59:16.621 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:16.617+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:16.636 INFO:teuthology.orchestra.run.smithi079.stdout:2554 read 0x283e87 thru 0x286eba (0x3034 bytes) 2024-09-21T13:59:16.639 INFO:teuthology.orchestra.run.smithi079.stdout:2555 trunc from 0x5af1a4b to 0x502dc05 2024-09-21T13:59:16.663 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:16.663 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:16.663 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:16.663 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:16.667 INFO:teuthology.orchestra.run.smithi079.stdout:2557 writesame 0x79a8124 thru 0x79a9a24 data_size 0x1(0x1901 bytes) 2024-09-21T13:59:16.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:16.683 INFO:teuthology.orchestra.run.smithi079.stdout:2558 write 0xcc2c92b thru 0xcc39e2b (0xd501 bytes) 2024-09-21T13:59:16.689 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.690 INFO:teuthology.orchestra.run.smithi079.stdout:2561 writesame 0x801f101 thru 0x802e9b0 data_size 0x5c(0xf8b0 bytes) 2024-09-21T13:59:16.696 INFO:teuthology.orchestra.run.smithi079.stdout:2562 punch from 0xaebb530 to 0xaebc2f7, (0xdc7 bytes) 2024-09-21T13:59:16.696 INFO:teuthology.orchestra.run.smithi079.stdout:2563 punch from 0x60d9aca to 0x60dba35, (0x1f6b bytes) 2024-09-21T13:59:16.696 INFO:teuthology.orchestra.run.smithi079.stdout:2566 write 0x9182731 thru 0x9182920 (0x1f0 bytes) 2024-09-21T13:59:16.700 INFO:teuthology.orchestra.run.smithi079.stdout:2567 write 0x14c2e04 thru 0x14c75b8 (0x47b5 bytes) 2024-09-21T13:59:16.704 INFO:teuthology.orchestra.run.smithi079.stdout:2568 write 0x50a4592 thru 0x50a7dca (0x3839 bytes) 2024-09-21T13:59:16.709 INFO:teuthology.orchestra.run.smithi079.stdout:2570 read 0x4ceb1dd thru 0x4cf1586 (0x63aa bytes) 2024-09-21T13:59:16.712 INFO:teuthology.orchestra.run.smithi079.stdout:2571 trunc from 0xcc39e2c to 0xb4f35d0 2024-09-21T13:59:16.722 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:16.721+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:16.727 INFO:teuthology.orchestra.run.smithi079.stdout:2572 read 0x74ee1a0 thru 0x74f10be (0x2f1f bytes) 2024-09-21T13:59:16.727 INFO:teuthology.orchestra.run.smithi079.stdout:2573 read 0x142f05e thru 0x142fd8e (0xd31 bytes) 2024-09-21T13:59:16.728 INFO:teuthology.orchestra.run.smithi079.stdout:2574 writesame 0xd1b7ae thru 0xd20e0c data_size 0x1(0x565f bytes) 2024-09-21T13:59:16.742 INFO:teuthology.orchestra.run.smithi079.stdout:2575 read 0x69090a6 thru 0x69123a0 (0x92fb bytes) 2024-09-21T13:59:16.759 INFO:teuthology.orchestra.run.smithi079.stdout:2576 trunc from 0xb4f35d0 to 0x54280f 2024-09-21T13:59:16.787 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.787 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.807 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:16.807 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:16.808 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:16.808 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:16.817 INFO:teuthology.orchestra.run.smithi079.stdout:2579 write 0xea01983 thru 0xea029a7 (0x1025 bytes) 2024-09-21T13:59:16.822 INFO:teuthology.orchestra.run.smithi079.stdout:2580 read 0x23238b9 thru 0x232eb96 (0xb2de bytes) 2024-09-21T13:59:16.822 INFO:teuthology.orchestra.run.smithi079.stdout:2581 read 0x78d74ae thru 0x78dc80d (0x5360 bytes) 2024-09-21T13:59:16.822 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.822 INFO:teuthology.orchestra.run.smithi079.stdout:2583 read 0x771e2ad thru 0x7724363 (0x60b7 bytes) 2024-09-21T13:59:16.822 INFO:teuthology.orchestra.run.smithi079.stdout:2585 write 0xb016509 thru 0xb019f2b (0x3a23 bytes) 2024-09-21T13:59:16.823 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:16.821+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:16.824 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:16.827 INFO:teuthology.orchestra.run.smithi079.stdout:2586 write 0xc452efb thru 0xc461cb6 (0xedbc bytes) 2024-09-21T13:59:16.832 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.832 INFO:teuthology.orchestra.run.smithi079.stdout:2588 punch from 0x793ecb2 to 0x794dda8, (0xf0f6 bytes) 2024-09-21T13:59:16.832 INFO:teuthology.orchestra.run.smithi079.stdout:2591 read 0xa44cf8c thru 0xa45a609 (0xd67e bytes) 2024-09-21T13:59:16.833 INFO:teuthology.orchestra.run.smithi079.stdout:2593 write 0x24f27c2 thru 0x24f44cf (0x1d0e bytes) 2024-09-21T13:59:16.837 INFO:teuthology.orchestra.run.smithi079.stdout:2594 punch from 0x54accf1 to 0x54b7991, (0xaca0 bytes) 2024-09-21T13:59:16.837 INFO:teuthology.orchestra.run.smithi079.stdout:2595 read 0x2065904 thru 0x2068f29 (0x3626 bytes) 2024-09-21T13:59:16.837 INFO:teuthology.orchestra.run.smithi079.stdout:2596 write 0x1f7b9c4 thru 0x1f87271 (0xb8ae bytes) 2024-09-21T13:59:16.844 INFO:teuthology.orchestra.run.smithi079.stdout:2597 punch from 0x4b4e34 to 0x4bf361, (0xa52d bytes) 2024-09-21T13:59:16.844 INFO:teuthology.orchestra.run.smithi079.stdout:2598 writesame 0xbee0147 thru 0xbee1452 data_size 0x2e(0x130c bytes) 2024-09-21T13:59:16.848 INFO:teuthology.orchestra.run.smithi079.stdout:2599 read 0x1de2c04 thru 0x1de47fe (0x1bfb bytes) 2024-09-21T13:59:16.859 INFO:teuthology.orchestra.run.smithi079.stdout:2600 trunc from 0xea029a8 to 0x8f70fec 2024-09-21T13:59:16.874 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.879 INFO:teuthology.orchestra.run.smithi079.stdout:2602 trunc from 0x8f70fec to 0xb056d49 2024-09-21T13:59:16.886 INFO:teuthology.orchestra.run.smithi079.stdout:2603 write 0x510a082 thru 0x5119a3b (0xf9ba bytes) 2024-09-21T13:59:16.891 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.891 INFO:teuthology.orchestra.run.smithi079.stdout:2605 read 0x813df90 thru 0x81482e7 (0xa358 bytes) 2024-09-21T13:59:16.891 INFO:teuthology.orchestra.run.smithi079.stdout:2606 read 0x16c4280 thru 0x16c9392 (0x5113 bytes) 2024-09-21T13:59:16.892 INFO:teuthology.orchestra.run.smithi079.stdout:2608 read 0x3180fbe thru 0x318214e (0x1191 bytes) 2024-09-21T13:59:16.892 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.892 INFO:teuthology.orchestra.run.smithi079.stdout:2610 write 0xa6be820 thru 0xa6c86e0 (0x9ec1 bytes) 2024-09-21T13:59:16.897 INFO:teuthology.orchestra.run.smithi079.stdout:2611 punch from 0x543b23 to 0x54ef10, (0xb3ed bytes) 2024-09-21T13:59:16.897 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:16.910 INFO:teuthology.orchestra.run.smithi079.stdout:2613 write 0xd8e5aa2 thru 0xd8e7f44 (0x24a3 bytes) 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 64, 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-21T13:57:52.430765+0000", 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-21T13:59:14.182502+0000", 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-21T13:58:48.323579+0000", 2024-09-21T13:59:16.920 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-21T13:59:06.429223+0000", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5804032, 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-21T13:59:16.921 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "reef", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:05.200492+0000", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-21T13:59:16.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-21T13:59:16.923 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "17", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:16.924 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:16.925 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:16.926 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 7.690000057220459, 2024-09-21T13:59:16.927 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 7.690000057220459, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.12999999523162842, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:10.681325+0000", 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:16.928 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:16.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "21", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 21, 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:16.930 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:16.931 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:16.932 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 3, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 3, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.75, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2.25, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2.25, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:16.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:20.114253+0000", 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:16.934 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:16.935 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:16.936 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:16.936 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:16.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "64", 2024-09-21T13:59:16.936 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:16.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:16.937 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:16.937 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 23, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 64, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:16.938 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:16.939 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 2, 2024-09-21T13:59:16.940 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 2, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.75, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "4f3cec52-e90a-4dc6-8a9d-879659a7f8b3", 2024-09-21T13:59:16.941 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 45, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.942 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.943 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.944 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-21T13:59:16.945 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6818/3285725925", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6823/3285725925", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/3285725925", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6827/3285725925", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.946 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "f30fdaae-2baf-49e5-b8c2-24477eabf5c6", 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 23, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.947 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:16.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6819/1533952849", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6822/1533952849", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6830/1533952849", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6826/1533952849", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "54acbaba-89a5-4b6c-bd93-89e0683f2125", 2024-09-21T13:59:16.952 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 42, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.953 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.954 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.955 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-21T13:59:16.956 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/3403916996", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/3403916996", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/3403916996", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/3403916996", 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.957 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "76fc66bf-6186-4666-b92f-c8093d20d625", 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.958 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 45, 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-21T13:59:16.960 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-21T13:59:16.962 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/3937234571", 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/3937234571", 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/3937234571", 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/3937234571", 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:59:16.963 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c90b7f74-168e-4c89-b1cf-c9ce463afa6e", 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 60, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6824", 2024-09-21T13:59:16.964 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6825", 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6826", 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6827", 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6830", 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6831", 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6828", 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.967 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6829", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6825/3468135680", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6827/3468135680", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3468135680", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3468135680", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "b837d993-44f1-4dd3-99f7-675e6abcd9c7", 2024-09-21T13:59:16.968 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 57, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6816", 2024-09-21T13:59:16.969 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6817", 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6818", 2024-09-21T13:59:16.970 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6819", 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6822", 2024-09-21T13:59:16.971 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6823", 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6820", 2024-09-21T13:59:16.972 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6821", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6817/3245816486", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6819/3245816486", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6823/3245816486", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6821/3245816486", 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.973 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c68ceefc-f355-4f66-870e-95ce4a9bc37e", 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.974 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 45, 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6808", 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6809", 2024-09-21T13:59:16.975 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6810", 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6811", 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.976 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6814", 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6815", 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6812", 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6813", 2024-09-21T13:59:16.978 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6809/2399307560", 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6811/2399307560", 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2399307560", 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2399307560", 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "e1909a46-859c-45e8-b84b-0e11db556c48", 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 0, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 39, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 45, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:16.980 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6800", 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6801", 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6802", 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6803", 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6806", 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6807", 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6804", 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6805", 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:16.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6801/2163234632", 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6803/2163234632", 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2163234632", 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2163234632", 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "exists" 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-21T13:59:16.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.368141+0000", 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.986 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 20208, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343412+0000", 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.987 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343898+0000", 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.285851+0000", 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.988 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.330406+0000", 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.989 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.151465+0000", 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.990 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.197502+0000", 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.171570+0000", 2024-09-21T13:59:16.991 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 45 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-21T13:59:16.992 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-21T13:59:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-21T13:59:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-21T13:59:16.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:16.994 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:16.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:16.995 INFO:teuthology.orchestra.run.smithi079.stdout:2614 trunc from 0xd8e7f45 to 0x84b031 2024-09-21T13:59:16.996 INFO:tasks.thrashosds.thrasher:j is {'epoch': 64, 'fsid': 'af11199c-39d9-4003-9df0-1f9fd66ab792', 'created': '2024-09-21T13:57:52.430765+0000', 'modified': '2024-09-21T13:59:14.182502+0000', 'last_up_change': '2024-09-21T13:58:48.323579+0000', 'last_in_change': '2024-09-21T13:59:06.429223+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:58:05.200492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T13:58:10.681325+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T13:58:20.114253+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6818', 'nonce': 3285725925}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 3285725925}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6829', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 3285725925}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6825', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 3285725925}]}, 'public_addr': '172.21.15.79:6818/3285725925', 'cluster_addr': '172.21.15.79:6823/3285725925', 'heartbeat_back_addr': '172.21.15.79:6831/3285725925', 'heartbeat_front_addr': '172.21.15.79:6827/3285725925', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6817', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1533952849}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6821', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6822', 'nonce': 1533952849}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6830', 'nonce': 1533952849}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6826', 'nonce': 1533952849}]}, 'public_addr': '172.21.15.79:6819/1533952849', 'cluster_addr': '172.21.15.79:6822/1533952849', 'heartbeat_back_addr': '172.21.15.79:6830/1533952849', 'heartbeat_front_addr': '172.21.15.79:6826/1533952849', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '54acbaba-89a5-4b6c-bd93-89e0683f2125', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 3403916996}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 3403916996}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 3403916996}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 3403916996}]}, 'public_addr': '172.21.15.79:6801/3403916996', 'cluster_addr': '172.21.15.79:6803/3403916996', 'heartbeat_back_addr': '172.21.15.79:6807/3403916996', 'heartbeat_front_addr': '172.21.15.79:6805/3403916996', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76fc66bf-6186-4666-b92f-c8093d20d625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 3937234571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 3937234571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 3937234571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 3937234571}]}, 'public_addr': '172.21.15.79:6809/3937234571', 'cluster_addr': '172.21.15.79:6811/3937234571', 'heartbeat_back_addr': '172.21.15.79:6815/3937234571', 'heartbeat_front_addr': '172.21.15.79:6813/3937234571', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 60, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3468135680}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3468135680}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3468135680}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3468135680}]}, 'public_addr': '172.21.15.134:6825/3468135680', 'cluster_addr': '172.21.15.134:6827/3468135680', 'heartbeat_back_addr': '172.21.15.134:6831/3468135680', 'heartbeat_front_addr': '172.21.15.134:6829/3468135680', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 57, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 3245816486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 3245816486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 3245816486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 3245816486}]}, 'public_addr': '172.21.15.134:6817/3245816486', 'cluster_addr': '172.21.15.134:6819/3245816486', 'heartbeat_back_addr': '172.21.15.134:6823/3245816486', 'heartbeat_front_addr': '172.21.15.134:6821/3245816486', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2399307560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2399307560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2399307560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2399307560}]}, 'public_addr': '172.21.15.134:6809/2399307560', 'cluster_addr': '172.21.15.134:6811/2399307560', 'heartbeat_back_addr': '172.21.15.134:6815/2399307560', 'heartbeat_front_addr': '172.21.15.134:6813/2399307560', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e1909a46-859c-45e8-b84b-0e11db556c48', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 45, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2163234632}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2163234632}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2163234632}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2163234632}]}, 'public_addr': '172.21.15.134:6801/2163234632', 'cluster_addr': '172.21.15.134:6803/2163234632', 'heartbeat_back_addr': '172.21.15.134:6807/2163234632', 'heartbeat_front_addr': '172.21.15.134:6805/2163234632', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.368141+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 20208, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343412+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343898+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.285851+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.330406+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.151465+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.197502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.171570+0000', 'dead_epoch': 45}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T13:59:16.997 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T13:59:16.997 INFO:teuthology.orchestra.run.smithi079.stdout:2616 punch from 0x4427c1 to 0x44768e, (0x4ecd bytes) 2024-09-21T13:59:16.997 INFO:teuthology.orchestra.run.smithi079.stdout:2618 trunc from 0x84b031 to 0xbaf9c2 2024-09-21T13:59:16.997 INFO:teuthology.orchestra.run.smithi079.stdout:2619 read 0x7198ab thru 0x71e52b (0x4c81 bytes) 2024-09-21T13:59:16.997 INFO:teuthology.orchestra.run.smithi079.stdout:2620 write 0x69476b1 thru 0x694a5a8 (0x2ef8 bytes) 2024-09-21T13:59:16.998 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:16.993+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187633887, 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:59:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187564227999999, 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:59:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:59:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187461652, 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:59:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187331383, 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:59:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:59:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187264194000001, 2024-09-21T13:59:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:59:17.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187158228000001, 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.187003719, 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.025 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:17.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:59:17.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:59:17.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186949143, 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:59:17.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186849726999998, 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:17.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186705601, 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186642272, 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:59:17.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:59:17.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:59:17.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186542746000001, 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:17.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:59:17.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186399127000001, 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:59:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186354664, 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186240585, 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:59:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:59:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.186105286, 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:59:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.185799348, 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.185469248, 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.185180806000002, 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.184926688000001, 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:59:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:59:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:17.080 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:17.081 INFO:teuthology.orchestra.run.smithi079.stdout:2621 write 0x7c1f29c thru 0x7c2f05c (0xfdc1 bytes) 2024-09-21T13:59:17.082 INFO:teuthology.orchestra.run.smithi079.stdout:2622 write 0x62a9eab thru 0x62b16ba (0x7810 bytes) 2024-09-21T13:59:17.082 INFO:teuthology.orchestra.run.smithi079.stdout:2623 clone 21 order 19 su 131072 sc 10 2024-09-21T13:59:17.082 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:17.123 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:17.121+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:17.146 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:17.147 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:17.163 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:17.163 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:17.180 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:17.180 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:17.196 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:17.196 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:17.196 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:17.193+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:17.213 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:59:17.219 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:17.219 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:17.239 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:17.240 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:17.260 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:17.260 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:17.260 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:17.261 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:17.261 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:17.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:17.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:17.275 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:17.319 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:17.317+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:17.398 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:17.397+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:17.400 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone20 from 0x7c2f05d (overlap 0x54280f) to 0x4bbda7 2024-09-21T13:59:17.450 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:17.450 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:17.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:17.499 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:17.497+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:17.600 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:17.597+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:17.638 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:17.638 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:17.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:17.701 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:17.697+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:17.801 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:17.797+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:17.825 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:17.825 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:17.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:17.865 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-21T13:59:17.902 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:17.897+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:17.947 INFO:teuthology.orchestra.run.smithi079.stdout:2624 write 0xc8149c5 thru 0xc8176de (0x2d1a bytes) 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:2628 read 0x7ae95b7 thru 0x7af1cf6 (0x8740 bytes) 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:2629 punch from 0x41b992b to 0x41c20be, (0x8793 bytes) 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:2631 read 0x4321856 thru 0x4324288 (0x2a33 bytes) 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:2634 read 0x4cfcd01 thru 0x4cfd5d2 (0x8d2 bytes) 2024-09-21T13:59:17.953 INFO:teuthology.orchestra.run.smithi079.stdout:2635 write 0x6a7e290 thru 0x6a85627 (0x7398 bytes) 2024-09-21T13:59:17.966 INFO:teuthology.orchestra.run.smithi079.stdout:2636 trunc from 0xc8176df to 0xa35fa5f 2024-09-21T13:59:17.987 INFO:teuthology.orchestra.run.smithi079.stdout:2637 read 0x9a0583b thru 0x9a0f678 (0x9e3e bytes) 2024-09-21T13:59:17.987 INFO:teuthology.orchestra.run.smithi079.stdout:2638 read 0x5d4c0a8 thru 0x5d5073f (0x4698 bytes) 2024-09-21T13:59:17.987 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:17.987 INFO:teuthology.orchestra.run.smithi079.stdout:2640 punch from 0x71c7506 to 0x71d1027, (0x9b21 bytes) 2024-09-21T13:59:17.988 INFO:teuthology.orchestra.run.smithi079.stdout:2641 writesame 0x188ff43 thru 0x18946a1 data_size 0xb(0x475f bytes) 2024-09-21T13:59:18.003 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:18.001+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:18.012 INFO:teuthology.orchestra.run.smithi079.stdout:2642 write 0xcd382a0 thru 0xcd39aa7 (0x1808 bytes) 2024-09-21T13:59:18.015 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.016 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.018 INFO:teuthology.orchestra.run.smithi079.stdout:2644 read 0x1d3aa8c thru 0x1d49237 (0xe7ac bytes) 2024-09-21T13:59:18.018 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.018 INFO:teuthology.orchestra.run.smithi079.stdout:2646 punch from 0x6f430c9 to 0x6f5254e, (0xf485 bytes) 2024-09-21T13:59:18.019 INFO:teuthology.orchestra.run.smithi079.stdout:2647 read 0xc2f7572 thru 0xc2fcafc (0x558b bytes) 2024-09-21T13:59:18.019 INFO:teuthology.orchestra.run.smithi079.stdout:2648 write 0x8ef28e thru 0x8f6bb1 (0x7924 bytes) 2024-09-21T13:59:18.026 INFO:teuthology.orchestra.run.smithi079.stdout:2649 read 0x2e62835 thru 0x2e660b6 (0x3882 bytes) 2024-09-21T13:59:18.027 INFO:teuthology.orchestra.run.smithi079.stdout:2650 read 0x3abbfd2 thru 0x3ac2091 (0x60c0 bytes) 2024-09-21T13:59:18.027 INFO:teuthology.orchestra.run.smithi079.stdout:2651 read 0x328c6ce thru 0x3295cdb (0x960e bytes) 2024-09-21T13:59:18.031 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:18.039 INFO:teuthology.orchestra.run.smithi079.stdout:2654 write 0xde54b47 thru 0xde5709d (0x2557 bytes) 2024-09-21T13:59:18.043 INFO:teuthology.orchestra.run.smithi079.stdout:2655 writesame 0x196aedc thru 0x1971759 data_size 0x32(0x687e bytes) 2024-09-21T13:59:18.050 INFO:teuthology.orchestra.run.smithi079.stdout:2657 writesame 0xb8f4d20 thru 0xb8f5004 data_size 0x3(0x2e5 bytes) 2024-09-21T13:59:18.055 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.056 INFO:teuthology.orchestra.run.smithi079.stdout:2660 write 0x330355b thru 0x3310de8 (0xd88e bytes) 2024-09-21T13:59:18.062 INFO:teuthology.orchestra.run.smithi079.stdout:2661 read 0x9afa17d thru 0x9b09b7f (0xfa03 bytes) 2024-09-21T13:59:18.062 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.063 INFO:teuthology.orchestra.run.smithi079.stdout:2663 write 0x9b7b139 thru 0x9b7de16 (0x2cde bytes) 2024-09-21T13:59:18.082 INFO:teuthology.orchestra.run.smithi079.stdout:2664 write 0xedda6bf thru 0xede4f73 (0xa8b5 bytes) 2024-09-21T13:59:18.088 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:2668 punch from 0x7bdb997 to 0x7be8f2e, (0xd597 bytes) 2024-09-21T13:59:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:2669 read 0x647137d thru 0x647974c (0x83d0 bytes) 2024-09-21T13:59:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:2672 read 0xad2db2d thru 0xad3c50d (0xe9e1 bytes) 2024-09-21T13:59:18.104 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:18.101+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:18.125 INFO:teuthology.orchestra.run.smithi079.stdout:2673 trunc from 0xede4f74 to 0x17fa87b 2024-09-21T13:59:18.157 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.157 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:18.205 INFO:teuthology.orchestra.run.smithi079.stdout:2674 writesame 0x99bd569 thru 0x99c8567 data_size 0x1(0xafff bytes) 2024-09-21T13:59:18.206 INFO:teuthology.orchestra.run.smithi079.stdout:2675 read 0x1add78b thru 0x1ae0bb9 (0x342f bytes) 2024-09-21T13:59:18.206 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.206 INFO:teuthology.orchestra.run.smithi079.stdout:2679 punch from 0x69b579d to 0x69b5db1, (0x614 bytes) 2024-09-21T13:59:18.207 INFO:teuthology.orchestra.run.smithi079.stdout:2680 write 0xe7a01e thru 0xe83cbb (0x9c9e bytes) 2024-09-21T13:59:18.207 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:18.201+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:18.212 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.212 INFO:teuthology.orchestra.run.smithi079.stdout:2684 punch from 0x4fc80dd to 0x4fd2766, (0xa689 bytes) 2024-09-21T13:59:18.232 INFO:teuthology.orchestra.run.smithi079.stdout:2685 writesame 0xe6210d5 thru 0xe6274fc data_size 0x14(0x6428 bytes) 2024-09-21T13:59:18.232 INFO:teuthology.orchestra.run.smithi079.stdout:2688 read 0x1382f25 thru 0x1386958 (0x3a34 bytes) 2024-09-21T13:59:18.232 INFO:teuthology.orchestra.run.smithi079.stdout:2689 read 0xce6d428 thru 0xce6dfac (0xb85 bytes) 2024-09-21T13:59:18.232 INFO:teuthology.orchestra.run.smithi079.stdout:2693 punch from 0xb8ce67f to 0xb8d8ce8, (0xa669 bytes) 2024-09-21T13:59:18.232 INFO:teuthology.orchestra.run.smithi079.stdout:2694 writesame 0x51193ff thru 0x511a256 data_size 0x24(0xe58 bytes) 2024-09-21T13:59:18.239 INFO:teuthology.orchestra.run.smithi079.stdout:2696 read 0x4f6e1ef thru 0x4f77fc6 (0x9dd8 bytes) 2024-09-21T13:59:18.239 INFO:teuthology.orchestra.run.smithi079.stdout:2697 punch from 0x277b850 to 0x2788953, (0xd103 bytes) 2024-09-21T13:59:18.239 INFO:teuthology.orchestra.run.smithi079.stdout:2699 writesame 0xdb0ea20 thru 0xdb16c05 data_size 0x2(0x81e6 bytes) 2024-09-21T13:59:18.252 INFO:teuthology.orchestra.run.smithi079.stdout:2700 write 0x27db959 thru 0x27e19c9 (0x6071 bytes) 2024-09-21T13:59:18.258 INFO:teuthology.orchestra.run.smithi079.stdout:2701 write 0x43e90d7 thru 0x43f830b (0xf235 bytes) 2024-09-21T13:59:18.264 INFO:teuthology.orchestra.run.smithi079.stdout:2703 read 0x2b8f998 thru 0x2b9a8e5 (0xaf4e bytes) 2024-09-21T13:59:18.264 INFO:teuthology.orchestra.run.smithi079.stdout:2704 read 0x6ff34d0 thru 0x7002417 (0xef48 bytes) 2024-09-21T13:59:18.264 INFO:teuthology.orchestra.run.smithi079.stdout:2705 read 0x35e064d thru 0x35e98ad (0x9261 bytes) 2024-09-21T13:59:18.264 INFO:teuthology.orchestra.run.smithi079.stdout:2706 writesame 0x51df846 thru 0x51e5e28 data_size 0x1(0x65e3 bytes) 2024-09-21T13:59:18.280 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.280 INFO:teuthology.orchestra.run.smithi079.stdout:2708 read 0x3a4c494 thru 0x3a58a3e (0xc5ab bytes) 2024-09-21T13:59:18.281 INFO:teuthology.orchestra.run.smithi079.stdout:2709 writesame 0x6527100 thru 0x652fde0 data_size 0x1(0x8ce1 bytes) 2024-09-21T13:59:18.306 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.306 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.307 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:18.305+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:18.317 INFO:teuthology.orchestra.run.smithi079.stdout:2710 read 0x1ff9fab thru 0x1ffbe29 (0x1e7f bytes) 2024-09-21T13:59:18.318 INFO:teuthology.orchestra.run.smithi079.stdout:2712 punch from 0xbe16f02 to 0xbe259a1, (0xea9f bytes) 2024-09-21T13:59:18.320 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:18.321 INFO:teuthology.orchestra.run.smithi079.stdout:2714 trunc from 0xe6274fd to 0xbc1f4f2 2024-09-21T13:59:18.343 INFO:teuthology.orchestra.run.smithi079.stdout:2715 writesame 0x778b02c thru 0x778ffaf data_size 0xe(0x4f84 bytes) 2024-09-21T13:59:18.351 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.351 INFO:teuthology.orchestra.run.smithi079.stdout:2717 writesame 0xee38cc thru 0xef0ea1 data_size 0x65(0xd5d6 bytes) 2024-09-21T13:59:18.357 INFO:teuthology.orchestra.run.smithi079.stdout:2718 read 0x6ab57c4 thru 0x6abcc98 (0x74d5 bytes) 2024-09-21T13:59:18.372 INFO:teuthology.orchestra.run.smithi079.stdout:2719 write 0xe31d6c0 thru 0xe32b30f (0xdc50 bytes) 2024-09-21T13:59:18.379 INFO:teuthology.orchestra.run.smithi079.stdout:2720 write 0xd1c284a thru 0xd1c4ebe (0x2675 bytes) 2024-09-21T13:59:18.384 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.384 INFO:teuthology.orchestra.run.smithi079.stdout:2724 write 0x7223651 thru 0x7226245 (0x2bf5 bytes) 2024-09-21T13:59:18.391 INFO:teuthology.orchestra.run.smithi079.stdout:2725 write 0xde4c29d thru 0xde5048f (0x41f3 bytes) 2024-09-21T13:59:18.396 INFO:teuthology.orchestra.run.smithi079.stdout:2726 write 0x7edf816 thru 0x7eef4ce (0xfcb9 bytes) 2024-09-21T13:59:18.404 INFO:teuthology.orchestra.run.smithi079.stdout:2727 read 0x57b5049 thru 0x57c0798 (0xb750 bytes) 2024-09-21T13:59:18.404 INFO:teuthology.orchestra.run.smithi079.stdout:2729 writesame 0x2611166 thru 0x261a015 data_size 0x18(0x8eb0 bytes) 2024-09-21T13:59:18.407 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:18.405+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:18.411 INFO:teuthology.orchestra.run.smithi079.stdout:2731 punch from 0x70cada3 to 0x70d9382, (0xe5df bytes) 2024-09-21T13:59:18.411 INFO:teuthology.orchestra.run.smithi079.stdout:2732 read 0xd77971f thru 0xd783478 (0x9d5a bytes) 2024-09-21T13:59:18.411 INFO:teuthology.orchestra.run.smithi079.stdout:2733 writesame 0x35eb543 thru 0x35f1ce6 data_size 0x2c(0x67a4 bytes) 2024-09-21T13:59:18.417 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.417 INFO:teuthology.orchestra.run.smithi079.stdout:2736 read 0xdb1f560 thru 0xdb2dc67 (0xe708 bytes) 2024-09-21T13:59:18.418 INFO:teuthology.orchestra.run.smithi079.stdout:2738 write 0x3ccda8d thru 0x3cd8263 (0xa7d7 bytes) 2024-09-21T13:59:18.424 INFO:teuthology.orchestra.run.smithi079.stdout:2739 write 0x45b0295 thru 0x45b28fc (0x2668 bytes) 2024-09-21T13:59:18.430 INFO:teuthology.orchestra.run.smithi079.stdout:2740 read 0xdade65a thru 0xdae875b (0xa102 bytes) 2024-09-21T13:59:18.438 INFO:teuthology.orchestra.run.smithi079.stdout:2741 trunc from 0xe32b310 to 0xb29f39f 2024-09-21T13:59:18.448 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.448 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.459 INFO:teuthology.orchestra.run.smithi079.stdout:2742 punch from 0x1c781dd to 0x1c81d72, (0x9b95 bytes) 2024-09-21T13:59:18.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:18.476 INFO:teuthology.orchestra.run.smithi079.stdout:2743 write 0xddc86a6 thru 0xddcd1be (0x4b19 bytes) 2024-09-21T13:59:18.482 INFO:teuthology.orchestra.run.smithi079.stdout:2744 write 0x70e2dbf thru 0x70f1058 (0xe29a bytes) 2024-09-21T13:59:18.485 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.485 INFO:teuthology.orchestra.run.smithi079.stdout:2746 read 0x7420f45 thru 0x742b259 (0xa315 bytes) 2024-09-21T13:59:18.485 INFO:teuthology.orchestra.run.smithi079.stdout:2747 read 0xd5a0594 thru 0xd5a87d5 (0x8242 bytes) 2024-09-21T13:59:18.485 INFO:teuthology.orchestra.run.smithi079.stdout:2748 read 0x3ef70c7 thru 0x3f0435a (0xd294 bytes) 2024-09-21T13:59:18.497 INFO:teuthology.orchestra.run.smithi079.stdout:2749 trunc from 0xddcd1bf to 0x71cf0c1 2024-09-21T13:59:18.508 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:18.505+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:18.522 INFO:teuthology.orchestra.run.smithi079.stdout:2750 read 0x202dbcb thru 0x203ce8f (0xf2c5 bytes) 2024-09-21T13:59:18.522 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.522 INFO:teuthology.orchestra.run.smithi079.stdout:2754 read 0x56fc370 thru 0x56fdd6d (0x19fe bytes) 2024-09-21T13:59:18.533 INFO:teuthology.orchestra.run.smithi079.stdout:2756 trunc from 0x71cf0c1 to 0xeab3dea 2024-09-21T13:59:18.546 INFO:teuthology.orchestra.run.smithi079.stdout:2757 read 0x2fd0c43 thru 0x2fdb8b6 (0xac74 bytes) 2024-09-21T13:59:18.558 INFO:teuthology.orchestra.run.smithi079.stdout:2759 trunc from 0xeab3dea to 0x8f40ee3 2024-09-21T13:59:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:2764 read 0x1e4ca1 thru 0x1e73f0 (0x2750 bytes) 2024-09-21T13:59:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:2766 read 0x1de1ff9 thru 0x1dea83f (0x8847 bytes) 2024-09-21T13:59:18.591 INFO:teuthology.orchestra.run.smithi079.stdout:2767 trunc from 0x8f40ee3 to 0xbcac70 2024-09-21T13:59:18.610 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:18.605+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:18.612 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.612 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:18.641 INFO:teuthology.orchestra.run.smithi079.stdout:2768 read 0x2ff1fd thru 0x309aa0 (0xa8a4 bytes) 2024-09-21T13:59:18.643 INFO:teuthology.orchestra.run.smithi079.stdout:2769 punch from 0x45e1ee to 0x46722f, (0x9041 bytes) 2024-09-21T13:59:18.663 INFO:teuthology.orchestra.run.smithi079.stdout:2770 write 0x40ad0b5 thru 0x40b4452 (0x739e bytes) 2024-09-21T13:59:18.670 INFO:teuthology.orchestra.run.smithi079.stdout:2771 write 0x1234026 thru 0x1234cd0 (0xcab bytes) 2024-09-21T13:59:18.674 INFO:teuthology.orchestra.run.smithi079.stdout:2772 read 0x3d64f9c thru 0x3d6885d (0x38c2 bytes) 2024-09-21T13:59:18.674 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.675 INFO:teuthology.orchestra.run.smithi079.stdout:2775 read 0x254271a thru 0x254ffab (0xd892 bytes) 2024-09-21T13:59:18.675 INFO:teuthology.orchestra.run.smithi079.stdout:2776 punch from 0x3081f0d to 0x30839c1, (0x1ab4 bytes) 2024-09-21T13:59:18.688 INFO:teuthology.orchestra.run.smithi079.stdout:2778 trunc from 0x40b4453 to 0xc212444 2024-09-21T13:59:18.709 INFO:teuthology.orchestra.run.smithi079.stdout:2780 trunc from 0xc212444 to 0x65fe9e4 2024-09-21T13:59:18.710 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:18.705+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:18.740 INFO:teuthology.orchestra.run.smithi079.stdout:2781 writesame 0xaad1a53 thru 0xaad5a90 data_size 0x3(0x403e bytes) 2024-09-21T13:59:18.741 INFO:teuthology.orchestra.run.smithi079.stdout:2782 writesame 0x21df6ba thru 0x21e74b7 data_size 0x1(0x7dfe bytes) 2024-09-21T13:59:18.771 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.772 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.778 INFO:teuthology.orchestra.run.smithi079.stdout:2783 punch from 0x119ad7e to 0x11a569c, (0xa91e bytes) 2024-09-21T13:59:18.778 INFO:teuthology.orchestra.run.smithi079.stdout:2784 read 0x405c94e thru 0x406b1bf (0xe872 bytes) 2024-09-21T13:59:18.778 INFO:teuthology.orchestra.run.smithi079.stdout:2785 writesame 0x75b8dae thru 0x75c6d06 data_size 0x3(0xdf59 bytes) 2024-09-21T13:59:18.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:18.797 INFO:teuthology.orchestra.run.smithi079.stdout:2786 write 0x4c7e958 thru 0x4c898a2 (0xaf4b bytes) 2024-09-21T13:59:18.805 INFO:teuthology.orchestra.run.smithi079.stdout:2788 write 0x53b5bee thru 0x53c276f (0xcb82 bytes) 2024-09-21T13:59:18.810 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:18.805+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:18.812 INFO:teuthology.orchestra.run.smithi079.stdout:2789 punch from 0x4f4fd8f to 0x4f5a791, (0xaa02 bytes) 2024-09-21T13:59:18.812 INFO:teuthology.orchestra.run.smithi079.stdout:2791 punch from 0x6b95957 to 0x6b9835d, (0x2a06 bytes) 2024-09-21T13:59:18.812 INFO:teuthology.orchestra.run.smithi079.stdout:2792 write 0x736c6 thru 0x7ae75 (0x77b0 bytes) 2024-09-21T13:59:18.820 INFO:teuthology.orchestra.run.smithi079.stdout:2795 read 0x1f04212 thru 0x1f1396a (0xf759 bytes) 2024-09-21T13:59:18.824 INFO:teuthology.orchestra.run.smithi079.stdout:2796 trunc from 0xaad5a91 to 0xcf9d709 2024-09-21T13:59:18.835 INFO:teuthology.orchestra.run.smithi079.stdout:2797 write 0x1aedb2 thru 0x1b83b1 (0x9600 bytes) 2024-09-21T13:59:18.852 INFO:teuthology.orchestra.run.smithi079.stdout:2799 writesame 0xeab9827 thru 0xeac719f data_size 0x1(0xd979 bytes) 2024-09-21T13:59:18.852 INFO:teuthology.orchestra.run.smithi079.stdout:2801 read 0x2c81f8f thru 0x2c8732a (0x539c bytes) 2024-09-21T13:59:18.852 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:18.864 INFO:teuthology.orchestra.run.smithi079.stdout:2804 trunc from 0xeac71a0 to 0x6c026b5 2024-09-21T13:59:18.886 INFO:teuthology.orchestra.run.smithi079.stdout:2805 read 0x4a90f28 thru 0x4a9f6c1 (0xe79a bytes) 2024-09-21T13:59:18.886 INFO:teuthology.orchestra.run.smithi079.stdout:2806 punch from 0x3e138b0 to 0x3e14602, (0xd52 bytes) 2024-09-21T13:59:18.887 INFO:teuthology.orchestra.run.smithi079.stdout:2808 trunc from 0x6c026b5 to 0x7c8fcb6 2024-09-21T13:59:18.912 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:18.909+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:18.920 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:18.920 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:18.920 INFO:teuthology.orchestra.run.smithi079.stdout:2809 write 0xca014ec thru 0xca06b6c (0x5681 bytes) 2024-09-21T13:59:18.926 INFO:teuthology.orchestra.run.smithi079.stdout:2811 read 0x190acd thru 0x195eb2 (0x53e6 bytes) 2024-09-21T13:59:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:2812 read 0x5794d85 thru 0x5794fc3 (0x23f bytes) 2024-09-21T13:59:18.927 INFO:teuthology.orchestra.run.smithi079.stdout:2813 writesame 0x39c2d24 thru 0x39cc66d data_size 0x7(0x994a bytes) 2024-09-21T13:59:18.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:18.938 INFO:teuthology.orchestra.run.smithi079.stdout:2815 punch from 0x6f4d258 to 0x6f575e9, (0xa391 bytes) 2024-09-21T13:59:18.938 INFO:teuthology.orchestra.run.smithi079.stdout:2816 punch from 0x32b50ef to 0x32c0620, (0xb531 bytes) 2024-09-21T13:59:18.938 INFO:teuthology.orchestra.run.smithi079.stdout:2817 read 0xb0b6323 thru 0xb0bedc8 (0x8aa6 bytes) 2024-09-21T13:59:18.938 INFO:teuthology.orchestra.run.smithi079.stdout:2818 write 0x6144ac thru 0x61ed89 (0xa8de bytes) 2024-09-21T13:59:18.948 INFO:teuthology.orchestra.run.smithi079.stdout:2822 punch from 0xc029fe1 to 0xc0399be, (0xf9dd bytes) 2024-09-21T13:59:18.948 INFO:teuthology.orchestra.run.smithi079.stdout:2824 punch from 0xc202b19 to 0xc20c01e, (0x9505 bytes) 2024-09-21T13:59:18.948 INFO:teuthology.orchestra.run.smithi079.stdout:2825 read 0xa6d87e1 thru 0xa6dfdf7 (0x7617 bytes) 2024-09-21T13:59:18.948 INFO:teuthology.orchestra.run.smithi079.stdout:2828 write 0x226f76c thru 0x2279b8b (0xa420 bytes) 2024-09-21T13:59:18.953 INFO:teuthology.orchestra.run.smithi079.stdout:2829 clone 22 order 24 su 524288 sc 9 2024-09-21T13:59:19.012 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:19.009+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:19.059 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:19.059 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:19.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:19.113 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:19.113+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:19.214 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:19.209+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:19.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:59:19.244 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:19.245 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:19.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:19.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:19.351 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:19.349+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:19.417 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:19.413+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:19.430 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:19.430 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:19.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:19.449 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone21 from 0xca06b6d (overlap 0xbcac70) to 0x713443 2024-09-21T13:59:19.478 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:19.478 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:19.496 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:19.496 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:19.513 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:19.513 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:19.518 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:19.513+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:19.530 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:19.553 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:19.553 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:19.583 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:19.583 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067246646999997, 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067135024000002, 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067115201, 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067091022, 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067066916999998, 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067048407999998, 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067038666000002, 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:19.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.067013807000002, 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:19.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:19.626 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066985129999999, 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066966311999998, 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:19.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:19.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:19.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066945640999997, 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:19.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066924569999998, 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:19.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:19.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:19.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:19.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066888718000001, 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:19.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066856496, 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:19.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066820856, 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:19.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066786378000003, 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:19.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:19.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:19.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066731818000001, 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:19.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:19.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066692652999997, 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066653916999996, 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:19.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.066629163999998, 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:19.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.685 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:19.687 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:19.687 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:19.688 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:19.688 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:19.688 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:19.689 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:19.685+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:19.788 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:19.785+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:19.826 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-21T13:59:19.854 INFO:teuthology.orchestra.run.smithi079.stdout:2831 trunc from 0xca06b6d to 0xc6cab4e 2024-09-21T13:59:19.868 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:178168 3.b 3:d1285a73:::rbd_data.1185ca67d680.000000000000000b:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 16777216 write_size 16777216,zero 6291456~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-21T13:59:19.868 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:19.868950+0000", 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00013507800000000001, 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018897200000000001, 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 178168 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:19.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.868950+0000", 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.868950+0000", 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.868948+0000", 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.868959+0000", 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1491999999999999e-05 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.868991+0000", 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1590000000000001e-05 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.869008+0000", 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7453999999999999e-05 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:19.869070+0000", 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1330999999999999e-05 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:19.872 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:19.873 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-21T13:59:19.873 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:19.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:19.888 INFO:teuthology.orchestra.run.smithi079.stdout:2832 writesame 0x2cedb94 thru 0x2cee241 data_size 0x1e(0x6ae bytes) 2024-09-21T13:59:19.889 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:19.885+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:19.904 INFO:teuthology.orchestra.run.smithi079.stdout:2833 trunc from 0xc6cab4e to 0xe6c728c 2024-09-21T13:59:19.911 INFO:teuthology.orchestra.run.smithi079.stdout:2834 write 0x599485a thru 0x5995d0f (0x14b6 bytes) 2024-09-21T13:59:19.914 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:19.914 INFO:teuthology.orchestra.run.smithi079.stdout:2836 write 0xb160902 thru 0xb16324f (0x294e bytes) 2024-09-21T13:59:19.917 INFO:teuthology.orchestra.run.smithi079.stdout:2837 write 0x9d34fe4 thru 0x9d3d8b6 (0x88d3 bytes) 2024-09-21T13:59:19.920 INFO:teuthology.orchestra.run.smithi079.stdout:2838 write 0x808315e thru 0x8091d40 (0xebe3 bytes) 2024-09-21T13:59:19.939 INFO:teuthology.orchestra.run.smithi079.stdout:2839 trunc from 0xe6c728c to 0xbd34703 2024-09-21T13:59:19.952 INFO:teuthology.orchestra.run.smithi079.stdout:2840 read 0xb65704 thru 0xb6dedc (0x87d9 bytes) 2024-09-21T13:59:19.953 INFO:teuthology.orchestra.run.smithi079.stdout:2841 read 0x516ba74 thru 0x5175bcb (0xa158 bytes) 2024-09-21T13:59:19.961 INFO:teuthology.orchestra.run.smithi079.stdout:2843 write 0xbf69490 thru 0xbf6b715 (0x2286 bytes) 2024-09-21T13:59:19.966 INFO:teuthology.orchestra.run.smithi079.stdout:2845 trunc from 0xbf6b716 to 0xd7687d7 2024-09-21T13:59:19.975 INFO:teuthology.orchestra.run.smithi079.stdout:2846 read 0xbde186d thru 0xbdefb7b (0xe30f bytes) 2024-09-21T13:59:19.975 INFO:teuthology.orchestra.run.smithi079.stdout:2847 write 0x9de87ee thru 0x9df0508 (0x7d1b bytes) 2024-09-21T13:59:19.978 INFO:teuthology.orchestra.run.smithi079.stdout:2848 read 0x4e15546 thru 0x4e1a50a (0x4fc5 bytes) 2024-09-21T13:59:19.989 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:19.985+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:19.990 INFO:teuthology.orchestra.run.smithi079.stdout:2849 write 0xebfb796 thru 0xec0a6f4 (0xef5f bytes) 2024-09-21T13:59:19.994 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:19.994 INFO:teuthology.orchestra.run.smithi079.stdout:2851 writesame 0xaceea1b thru 0xacfb0fd data_size 0x11(0xc6e3 bytes) 2024-09-21T13:59:20.000 INFO:teuthology.orchestra.run.smithi079.stdout:2852 read 0x30971b1 thru 0x30a0366 (0x91b6 bytes) 2024-09-21T13:59:20.004 INFO:teuthology.orchestra.run.smithi079.stdout:2853 trunc from 0xec0a6f5 to 0xc4d8add 2024-09-21T13:59:20.018 INFO:teuthology.orchestra.run.smithi079.stdout:2854 read 0x762ea91 thru 0x7634110 (0x5680 bytes) 2024-09-21T13:59:20.018 INFO:teuthology.orchestra.run.smithi079.stdout:2855 punch from 0x220d179 to 0x2219f9b, (0xce22 bytes) 2024-09-21T13:59:20.018 INFO:teuthology.orchestra.run.smithi079.stdout:2856 write 0xa535afa thru 0xa53cbb5 (0x70bc bytes) 2024-09-21T13:59:20.019 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:20.019 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:20.019 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:20.020 INFO:teuthology.orchestra.run.smithi079.stdout:2858 write 0x96fa808 thru 0x96fe454 (0x3c4d bytes) 2024-09-21T13:59:20.023 INFO:teuthology.orchestra.run.smithi079.stdout:2859 write 0x7bee693 thru 0x7bf88aa (0xa218 bytes) 2024-09-21T13:59:20.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:20.038 INFO:teuthology.orchestra.run.smithi079.stdout:2860 read 0x88f4062 thru 0x88f5db9 (0x1d58 bytes) 2024-09-21T13:59:20.038 INFO:teuthology.orchestra.run.smithi079.stdout:2861 write 0x2dbd7b1 thru 0x2dc2778 (0x4fc8 bytes) 2024-09-21T13:59:20.053 INFO:teuthology.orchestra.run.smithi079.stdout:2862 read 0x97563d4 thru 0x975baf0 (0x571d bytes) 2024-09-21T13:59:20.054 INFO:teuthology.orchestra.run.smithi079.stdout:2864 punch from 0x2496ac0 to 0x24a4319, (0xd859 bytes) 2024-09-21T13:59:20.065 INFO:teuthology.orchestra.run.smithi079.stdout:2865 writesame 0xe08e90d thru 0xe09ae95 data_size 0x1(0xc589 bytes) 2024-09-21T13:59:20.067 INFO:teuthology.orchestra.run.smithi079.stdout:2867 write 0x8292051 thru 0x8294bc4 (0x2b74 bytes) 2024-09-21T13:59:20.084 INFO:teuthology.orchestra.run.smithi079.stdout:2869 write 0x1b005b6 thru 0x1b0f46f (0xeeba bytes) 2024-09-21T13:59:20.086 INFO:teuthology.orchestra.run.smithi079.stdout:2870 write 0x4aed7a4 thru 0x4af8868 (0xb0c5 bytes) 2024-09-21T13:59:20.090 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:20.085+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:20.090 INFO:teuthology.orchestra.run.smithi079.stdout:2871 write 0x9dbddd8 thru 0x9dc0250 (0x2479 bytes) 2024-09-21T13:59:20.092 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:20.093 INFO:teuthology.orchestra.run.smithi079.stdout:2874 read 0xb339b85 thru 0xb342ca1 (0x911d bytes) 2024-09-21T13:59:20.093 INFO:teuthology.orchestra.run.smithi079.stdout:2875 write 0xdce0cf6 thru 0xdcebabd (0xadc8 bytes) 2024-09-21T13:59:20.096 INFO:teuthology.orchestra.run.smithi079.stdout:2876 writesame 0x1cab310 thru 0x1cb6cf9 data_size 0x35(0xb9ea bytes) 2024-09-21T13:59:20.111 INFO:teuthology.orchestra.run.smithi079.stdout:2877 write 0x7117789 thru 0x7119a79 (0x22f1 bytes) 2024-09-21T13:59:20.115 INFO:teuthology.orchestra.run.smithi079.stdout:2879 trunc from 0xe09ae96 to 0xec72adb 2024-09-21T13:59:20.127 INFO:teuthology.orchestra.run.smithi079.stdout:2881 trunc from 0xec72adb to 0xbfb1448 2024-09-21T13:59:20.138 INFO:teuthology.orchestra.run.smithi079.stdout:2882 write 0x1ad936b thru 0x1ae006e (0x6d04 bytes) 2024-09-21T13:59:20.140 INFO:teuthology.orchestra.run.smithi079.stdout:2883 punch from 0x928cbfd to 0x9293ba3, (0x6fa6 bytes) 2024-09-21T13:59:20.140 INFO:teuthology.orchestra.run.smithi079.stdout:2884 write 0xb4d4e thru 0xb8fb1 (0x4264 bytes) 2024-09-21T13:59:20.144 INFO:teuthology.orchestra.run.smithi079.stdout:2887 write 0x6a9f08d thru 0x6aa97e5 (0xa759 bytes) 2024-09-21T13:59:20.158 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:20.158 INFO:teuthology.orchestra.run.smithi079.stdout:2889 read 0xb33739f thru 0xb341920 (0xa582 bytes) 2024-09-21T13:59:20.159 INFO:teuthology.orchestra.run.smithi079.stdout:2890 read 0x83e8394 thru 0x83eeed8 (0x6b45 bytes) 2024-09-21T13:59:20.159 INFO:teuthology.orchestra.run.smithi079.stdout:2893 write 0x1fdb86 thru 0x1fe9fc (0xe77 bytes) 2024-09-21T13:59:20.161 INFO:teuthology.orchestra.run.smithi079.stdout:2894 writesame 0x1eb9d50 thru 0x1ebb4bf data_size 0x4(0x1770 bytes) 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.768389094, 2024-09-21T13:59:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.728302255999999, 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.666989000000001, 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133358 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 76800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358784305, 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058918719000000001, 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133358 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811181+0000", 2024-09-21T13:59:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811185+0000", 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811193+0000", 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1289999999999996e-06 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811200+0000", 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7129999999999999e-06 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869833+0000", 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058633115999999999 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869948+0000", 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115584 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870101+0000", 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152287 2024-09-21T13:59:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133359 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358760836999998, 2024-09-21T13:59:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059286298000000001, 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133359 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811205+0000", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811208+0000", 2024-09-21T13:59:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2729999999999998e-06 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811216+0000", 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.259e-06 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811223+0000", 2024-09-21T13:59:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6259999999999997e-06 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870168+0000", 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058945164000000001 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870311+0000", 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142464 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870492+0000", 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181118 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133360 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 87040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358737700999999, 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059596781000000001, 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133360 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811228+0000", 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811231+0000", 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.196e-06 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811239+0000", 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-09-21T13:59:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811246+0000", 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6100000000000002e-06 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870555+0000", 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059309029999999999 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870673+0000", 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118363 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870825+0000", 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015213600000000001 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133361 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 92160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358714859999999, 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059958546000000001, 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133361 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811254+0000", 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.337e-06 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811262+0000", 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1659999999999994e-06 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811269+0000", 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5930000000000002e-06 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870893+0000", 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059623968999999999 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871028+0000", 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135501 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871210+0000", 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018161699999999999 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133362 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 97280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358691528000001, 2024-09-21T13:59:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060278945, 2024-09-21T13:59:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133362 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811274+0000", 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811277+0000", 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000001e-06 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811285+0000", 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9119999999999998e-06 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811292+0000", 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6200000000000001e-06 2024-09-21T13:59:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871273+0000", 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059980588000000001 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871400+0000", 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127525 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871554+0000", 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015371300000000001 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133363 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 103424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358653961000002, 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060623992000000002, 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133363 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811315+0000", 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3529999999999999e-06 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811324+0000", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5089999999999993e-06 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811330+0000", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871620+0000", 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060289397000000002 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871753+0000", 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132908 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871936+0000", 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000183881 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133364 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358630398999999, 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060935982, 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133364 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811335+0000", 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811339+0000", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2229999999999999e-06 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811347+0000", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2730000000000002e-06 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811353+0000", 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5989999999999998e-06 2024-09-21T13:59:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871999+0000", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060645731000000001 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872119+0000", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119867 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872272+0000", 2024-09-21T13:59:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015293199999999999 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133365 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 113664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358607173999999, 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.06130443, 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133365 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811362+0000", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2160000000000002e-06 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811370+0000", 2024-09-21T13:59:20.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811376+0000", 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3799999999999999e-06 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872342+0000", 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060965424999999997 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872482+0000", 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014024400000000001 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872664+0000", 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018166499999999999 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133366 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 118784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358584244999999, 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061625971000000002, 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133366 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811385+0000", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.332e-06 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811393+0000", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170000000000004e-06 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811400+0000", 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6889999999999998e-06 2024-09-21T13:59:20.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872726+0000", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061325932999999999 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872856+0000", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130588 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873008+0000", 2024-09-21T13:59:20.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000151905 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133367 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 123904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358561046999998, 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061995883000000002, 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133367 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811408+0000", 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.14e-06 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811416+0000", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0490000000000004e-06 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811422+0000", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873082+0000", 2024-09-21T13:59:20.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061659985 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873224+0000", 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014196400000000001 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873401+0000", 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017682099999999999 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133368 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 129024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358538331999998, 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062336753000000002, 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133368 2024-09-21T13:59:20.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811427+0000", 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811454+0000", 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6825000000000002e-05 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811464+0000", 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5990000000000008e-06 2024-09-21T13:59:20.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811471+0000", 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873463+0000", 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061991549 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873609+0000", 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014674999999999999 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873765+0000", 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155456 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133369 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 135168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358489098, 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062595426999999995, 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133369 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811480+0000", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.18e-06 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811488+0000", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811495+0000", 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.686e-06 2024-09-21T13:59:20.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873807+0000", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062312233000000002 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873921+0000", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113486 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874073+0000", 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152156 2024-09-21T13:59:20.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133370 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 140288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358465793000001, 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063038644000000005, 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133370 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811500+0000", 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811503+0000", 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5020000000000001e-06 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811512+0000", 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811518+0000", 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7660000000000001e-06 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874173+0000", 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062654177000000005 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874335+0000", 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016219499999999999 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874539+0000", 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133371 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 145408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358442405000002, 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0633967, 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133371 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811523+0000", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811527+0000", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811535+0000", 2024-09-21T13:59:20.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811542+0000", 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874635+0000", 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063093623000000001 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874762+0000", 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012691199999999999 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874921+0000", 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848899999999999 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133372 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 150528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:20.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358419086000001, 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063676675000000002, 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133372 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:20.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811550+0000", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1889999999999999e-06 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811558+0000", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1769999999999998e-06 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811565+0000", 2024-09-21T13:59:20.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874963+0000", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063398191000000007 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875075+0000", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011169499999999999 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875224+0000", 2024-09-21T13:59:20.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014938700000000001 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133373 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358393908, 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064102759999999995, 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133373 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811575+0000", 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811583+0000", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4090000000000003e-06 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811590+0000", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0559999999999999e-06 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875318+0000", 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063727151999999995 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875477+0000", 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015933500000000001 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875675+0000", 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019835400000000001 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133374 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 160768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.358367216000001, 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064394145999999999, 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:20.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133374 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:20.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:20.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811598+0000", 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811603+0000", 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2499999999999997e-06 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:20.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811619+0000", 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5736e-05 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811633+0000", 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3862e-05 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:20.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875721+0000", 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064088110000000004 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875838+0000", 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116801 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875993+0000", 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015558400000000001 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:20.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:20.282 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:20.283 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:20.283 INFO:teuthology.orchestra.run.smithi079.stdout:2898 trunc from 0xbfb1448 to 0xb5f43f1 2024-09-21T13:59:20.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:20.284 INFO:teuthology.orchestra.run.smithi079.stdout:2899 trunc from 0xb5f43f1 to 0xc4485aa 2024-09-21T13:59:20.284 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:20.284 INFO:teuthology.orchestra.run.smithi079.stdout:2901 punch from 0x865e2a2 to 0x86618ec, (0x364a bytes) 2024-09-21T13:59:20.285 INFO:teuthology.orchestra.run.smithi079.stdout:2902 trunc from 0xc4485aa to 0x2fb5891 2024-09-21T13:59:20.285 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2903 punch from 0x25b05e9 to 0x25bf967, (0xf37e bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2904 trunc from 0x2fb5891 to 0x9b4933e 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2905 punch from 0x48dbc3d to 0x48e10d4, (0x5497 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2906 punch from 0x542af95 to 0x5438948, (0xd9b3 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2907 read 0x8c60e6e thru 0x8c6bbd9 (0xad6c bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2909 punch from 0x6e43d01 to 0x6e513d1, (0xd6d0 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2910 write 0x7e98a6f thru 0x7ea775f (0xecf1 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2912 read 0x92b9bba thru 0x92c8792 (0xebd9 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2913 read 0x40f4ed7 thru 0x40f68a6 (0x19d0 bytes) 2024-09-21T13:59:20.287 INFO:teuthology.orchestra.run.smithi079.stdout:2914 write 0x1d0cfb5 thru 0x1d14ffe (0x804a bytes) 2024-09-21T13:59:20.288 INFO:teuthology.orchestra.run.smithi079.stdout:2915 read 0x340e1dc thru 0x341d696 (0xf4bb bytes) 2024-09-21T13:59:20.288 INFO:teuthology.orchestra.run.smithi079.stdout:2916 read 0x9400c15 thru 0x9408d19 (0x8105 bytes) 2024-09-21T13:59:20.288 INFO:teuthology.orchestra.run.smithi079.stdout:2917 read 0x37dc38 thru 0x386cd7 (0x90a0 bytes) 2024-09-21T13:59:20.288 INFO:teuthology.orchestra.run.smithi079.stdout:2918 read 0x2f7ba95 thru 0x2f7f44c (0x39b8 bytes) 2024-09-21T13:59:20.288 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:20.281+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:20.289 INFO:teuthology.orchestra.run.smithi079.stdout:2919 read 0x7502cb9 thru 0x7511ad0 (0xee18 bytes) 2024-09-21T13:59:20.290 INFO:teuthology.orchestra.run.smithi079.stdout:2920 write 0x6b46683 thru 0x6b51aa4 (0xb422 bytes) 2024-09-21T13:59:20.292 INFO:teuthology.orchestra.run.smithi079.stdout:2921 write 0x46fbb9e thru 0x4708c7d (0xd0e0 bytes) 2024-09-21T13:59:20.295 INFO:teuthology.orchestra.run.smithi079.stdout:2923 punch from 0x19d892e to 0x19e58fc, (0xcfce bytes) 2024-09-21T13:59:20.295 INFO:teuthology.orchestra.run.smithi079.stdout:2924 punch from 0x537978d to 0x5385ecb, (0xc73e bytes) 2024-09-21T13:59:20.295 INFO:teuthology.orchestra.run.smithi079.stdout:2925 writesame 0x2fe15fc thru 0x2fe74db data_size 0x30(0x5ee0 bytes) 2024-09-21T13:59:20.297 INFO:teuthology.orchestra.run.smithi079.stdout:2926 read 0xc349ed thru 0xc37cc1 (0x32d5 bytes) 2024-09-21T13:59:20.310 INFO:teuthology.orchestra.run.smithi079.stdout:2927 write 0xccb19f3 thru 0xccc0809 (0xee17 bytes) 2024-09-21T13:59:20.315 INFO:teuthology.orchestra.run.smithi079.stdout:2928 punch from 0xa80de66 to 0xa8144aa, (0x6644 bytes) 2024-09-21T13:59:20.315 INFO:teuthology.orchestra.run.smithi079.stdout:2929 write 0x305108 thru 0x311210 (0xc109 bytes) 2024-09-21T13:59:20.318 INFO:teuthology.orchestra.run.smithi079.stdout:2930 punch from 0x62bf27d to 0x62c051f, (0x12a2 bytes) 2024-09-21T13:59:20.318 INFO:teuthology.orchestra.run.smithi079.stdout:2932 read 0xd4402f thru 0xd4bfa6 (0x7f78 bytes) 2024-09-21T13:59:20.318 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:20.318 INFO:teuthology.orchestra.run.smithi079.stdout:2934 writesame 0x96768b9 thru 0x967c19b data_size 0x29(0x58e3 bytes) 2024-09-21T13:59:20.331 INFO:teuthology.orchestra.run.smithi079.stdout:2935 trunc from 0xccc080a to 0x847e3d9 2024-09-21T13:59:20.362 INFO:teuthology.orchestra.run.smithi079.stdout:2936 trunc from 0x847e3d9 to 0x348d12b 2024-09-21T13:59:20.375 INFO:teuthology.orchestra.run.smithi079.stdout:2937 writesame 0x1d7403 thru 0x1e5a0f data_size 0x43(0xe60d bytes) 2024-09-21T13:59:20.379 INFO:teuthology.orchestra.run.smithi079.stdout:2938 read 0xa84075 thru 0xa8b78a (0x7716 bytes) 2024-09-21T13:59:20.383 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:20.381+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:20.416 INFO:teuthology.orchestra.run.smithi079.stdout:2939 write 0xd9c5994 thru 0xd9c9b91 (0x41fe bytes) 2024-09-21T13:59:20.422 INFO:teuthology.orchestra.run.smithi079.stdout:2940 punch from 0x258b907 to 0x258d67d, (0x1d76 bytes) 2024-09-21T13:59:20.425 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:20.426 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:20.426 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:20.434 INFO:teuthology.orchestra.run.smithi079.stdout:2941 write 0xe21792f thru 0xe22186f (0x9f41 bytes) 2024-09-21T13:59:20.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:20.441 INFO:teuthology.orchestra.run.smithi079.stdout:2942 write 0xbe1ecd3 thru 0xbe2e094 (0xf3c2 bytes) 2024-09-21T13:59:20.444 INFO:teuthology.orchestra.run.smithi079.stdout:2944 read 0xad476c thru 0xae178b (0xd020 bytes) 2024-09-21T13:59:20.445 INFO:teuthology.orchestra.run.smithi079.stdout:2945 read 0x3c02a34 thru 0x3c0d7ea (0xadb7 bytes) 2024-09-21T13:59:20.445 INFO:teuthology.orchestra.run.smithi079.stdout:2947 punch from 0xa3c9f7b to 0xa3d60e9, (0xc16e bytes) 2024-09-21T13:59:20.446 INFO:teuthology.orchestra.run.smithi079.stdout:2948 write 0x72b02ca thru 0x72bfc90 (0xf9c7 bytes) 2024-09-21T13:59:20.462 INFO:teuthology.orchestra.run.smithi079.stdout:2949 trunc from 0xe221870 to 0x8f9109b 2024-09-21T13:59:20.485 INFO:teuthology.orchestra.run.smithi079.stdout:2950 clone 23 order 24 su 8388608 sc 11 2024-09-21T13:59:20.486 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:20.485+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:20.560 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:20.560 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:20.561 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:20.561 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:20.561 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:20.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:20.619 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:20.617+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:20.686 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:20.681+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:20.746 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.933348887999998, 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:59:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:59:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.933279229, 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:59:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.933176652999997, 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:59:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:59:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.933046384000001, 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:59:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932979195000001, 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932873229000002, 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932718719999997, 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932664144, 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932564728000003, 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:59:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932420602000001, 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:59:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932357273000001, 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:59:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:59:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932257747000001, 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:59:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932114128000002, 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.932069665, 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:59:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:59:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:59:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.931955586000001, 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.931820287000001, 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:59:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.931514348999997, 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:59:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.931184248999998, 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:59:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:59:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.930895806999999, 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:59:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:59:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.930641688999998, 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:20.829 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:20.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:20.831 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:20.829+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:20.932 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:20.929+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:21.003 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.004 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:21.004 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:21.004 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:21.032 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:21.033+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:21.133 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:21.133+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:21.138 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.138 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:21.138 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:21.138 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:21.138 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.153 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:21.233 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:21.229+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64133 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10911744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:21.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434507105000002, 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069056558000000004, 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64133 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:21.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838062+0000", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4899999999999999e-06 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838070+0000", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5639999999999999e-06 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838083+0000", 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2713e-05 2024-09-21T13:59:21.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906781+0000", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068698555999999994 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906938+0000", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015647400000000001 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907117+0000", 2024-09-21T13:59:21.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017901899999999999 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64134 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10733568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434480792999999, 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069333364999999994, 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64134 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838088+0000", 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000002e-06 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838093+0000", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8659999999999997e-06 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838098+0000", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8189999999999999e-06 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907174+0000", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069075937000000004 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907295+0000", 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121527 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907420+0000", 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124387 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64135 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10928128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434464112000001, 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595481000000001, 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64135 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:21.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838105+0000", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838115+0000", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4180000000000003e-06 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838120+0000", 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-06 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907465+0000", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069345748999999998 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907550+0000", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4190999999999994e-05 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907699+0000", 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014886599999999999 2024-09-21T13:59:21.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64136 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10749952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434443688999998, 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069879827000000005, 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64136 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838125+0000", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838132+0000", 2024-09-21T13:59:21.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.798e-06 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838137+0000", 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3550000000000004e-06 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907777+0000", 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069639767000000005 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907881+0000", 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103658 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908003+0000", 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122578 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64137 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10944512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:21.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434351820000003, 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070170959000000005, 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64137 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838218+0000", 2024-09-21T13:59:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9430000000000002e-06 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838230+0000", 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838239+0000", 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6680000000000007e-06 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908053+0000", 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069814478999999999 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908197+0000", 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143948 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908386+0000", 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018891200000000001 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64138 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10766336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434307037000004, 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070426890000000006, 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64138 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838259+0000", 2024-09-21T13:59:21.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838264+0000", 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838274+0000", 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7159999999999998e-06 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838281+0000", 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.968e-06 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908460+0000", 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070179149999999996 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908561+0000", 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101364 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908687+0000", 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012597800000000001 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64139 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10960896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.434280504999997, 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070767155999999998, 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64139 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838286+0000", 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838289+0000", 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838297+0000", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0649999999999999e-06 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838304+0000", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4330000000000001e-06 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908754+0000", 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070449759000000001 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908904+0000", 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150168 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909054+0000", 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015012900000000001 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64140 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10782720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.433816516999997, 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070604650000000005, 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64140 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838309+0000", 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999558 2024-09-21T13:59:21.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838772+0000", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046326800000000002 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838784+0000", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1932e-05 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838792+0000", 2024-09-21T13:59:21.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1640000000000001e-06 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909106+0000", 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070314146999999994 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909226+0000", 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001197 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909355+0000", 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000129412 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64141 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10977280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.433304431000003, 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070343271999999998, 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64141 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:21.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838799+0000", 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995365 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839267+0000", 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046808499999999997 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839278+0000", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0943e-05 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839287+0000", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3259999999999996e-06 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909412+0000", 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070125259999999995 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909493+0000", 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1191000000000002e-05 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909606+0000", 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113001 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.315 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64142 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10799104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.432923733000003, 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070248221, 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64142 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:21.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839294+0000", 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.99965 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839648+0000", 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035480400000000001 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839658+0000", 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6080000000000002e-06 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839663+0000", 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.074e-06 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909646+0000", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069982588999999998 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909769+0000", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012363200000000001 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909892+0000", 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122342 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64143 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10993664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.432491796999997, 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070150836999999994, 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64143 2024-09-21T13:59:21.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839681+0000", 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996057 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840080+0000", 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000399341 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840091+0000", 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0694e-05 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840099+0000", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909939+0000", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069839335000000002 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910038+0000", 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9512999999999994e-05 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910226+0000", 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018791599999999999 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64144 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10815488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.431918164999999, 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069887875000000002, 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64144 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840121+0000", 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994721 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840653+0000", 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053217200000000003 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840662+0000", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2600000000000005e-06 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840670+0000", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4740000000000005e-06 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910299+0000", 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069628667000000005 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910405+0000", 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105778 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910537+0000", 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132199 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64145 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10831872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.431480592, 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069831590999999998, 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64145 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:21.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840703+0000", 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996161 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841092+0000", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038957299999999999 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841101+0000", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6840000000000002e-06 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841108+0000", 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910605+0000", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069497009999999998 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910760+0000", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015446000000000001 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910918+0000", 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015825299999999999 2024-09-21T13:59:21.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64146 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10489856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.430934809, 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069574639999999993, 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64146 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841132+0000", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994998 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841637+0000", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050520100000000004 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841645+0000", 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8949999999999998e-06 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841652+0000", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3620000000000002e-06 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910965+0000", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069313079 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911082+0000", 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116834 2024-09-21T13:59:21.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911207+0000", 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125365 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64147 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10848256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.430605346, 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069517756999999999, 2024-09-21T13:59:21.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64147 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841659+0000", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996972 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841967+0000", 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030764399999999998 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841976+0000", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6909999999999992e-06 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841984+0000", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0059999999999992e-06 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911268+0000", 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069284088999999993 2024-09-21T13:59:21.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911365+0000", 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6559999999999997e-05 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911480+0000", 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64148 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10506240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.430174942000001, 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069398185000000001, 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64148 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842030+0000", 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996371 2024-09-21T13:59:21.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842397+0000", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036758100000000002 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842408+0000", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0438999999999999e-05 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842416+0000", 2024-09-21T13:59:21.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1349999999999992e-06 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911554+0000", 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069138738000000005 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911667+0000", 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112936 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911790+0000", 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122996 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64149 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10864640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.429669255, 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069236906000000001, 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64149 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:21.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842447+0000", 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995494 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842903+0000", 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045564299999999999 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842913+0000", 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0193999999999999e-05 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842921+0000", 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.14e-06 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911840+0000", 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068918980000000005 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911943+0000", 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912135+0000", 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019169 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64150 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10522624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.429176746000003, 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069209838999999995, 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64150 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842929+0000", 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995384 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843395+0000", 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046669300000000001 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843407+0000", 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1262e-05 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843415+0000", 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2609999999999993e-06 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912299+0000", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068884538999999995 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912456+0000", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015631900000000001 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912600+0000", 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014456899999999999 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.354 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64165 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10995712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.423722237, 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069022151000000004, 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64165 2024-09-21T13:59:21.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848844+0000", 2024-09-21T13:59:21.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848850+0000", 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2319999999999998e-06 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848864+0000", 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.377e-05 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848876+0000", 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2396e-05 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917682+0000", 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068805955000000002 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917762+0000", 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9967000000000002e-05 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917867+0000", 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104956 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64167 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10491904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.423074915000001, 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069104480999999995, 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64167 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:21.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849491+0000", 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849495+0000", 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3749999999999999e-06 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849502+0000", 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2749999999999998e-06 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849508+0000", 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000002e-06 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918416+0000", 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068908419999999998 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918494+0000", 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7570000000000004e-05 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918597+0000", 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102673 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.363 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.365 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:21.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:21.361+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:21.466 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:21.461+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:21.543 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.544 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:21.544 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:21.544 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:21.591 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone22 from 0x8f9109b (overlap 0x2fb5891) to 0x0 2024-09-21T13:59:21.599 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:21.597+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:21.668 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:21.665+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:21.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:21.720 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.721 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:21.721 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:21.721 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:21.721 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.735 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:21.769 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:21.765+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:21.854 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:21.854 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:21.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.983703669999997, 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.975826507000001, 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:21.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971889484999998, 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:21.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971878275999998, 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971867103999998, 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:21.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971852800999997, 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:21.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971817340999998, 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:21.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:21.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971804177999999, 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.894 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.971792647000001, 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:21.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:21.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967804678999997, 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:21.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967785047, 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:21.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:21.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967760218999999, 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967735222000002, 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:21.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:21.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:21.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967723151999998, 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:21.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967711831999999, 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:21.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967700690999997, 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:21.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:21.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:21.933 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967688389999999, 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.934 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:21.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:21.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.967677137999999, 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:21.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.891607385999997, 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:21.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:21.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:21.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:21.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.882380810000001, 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:21.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:21.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:21.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:21.953 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:21.954 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:21.954 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:21.955 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:21.955 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:21.955 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:21.949+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:21.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:21.956 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:21.956 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:21.957 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:21.957 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:21.958 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:21.958 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-21T13:59:21.968 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:21.968 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:21.977 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:21.977 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:21.993 INFO:teuthology.orchestra.run.smithi079.stdout:2954 punch from 0x45bb715 to 0x45bbebb, (0x7a6 bytes) 2024-09-21T13:59:21.997 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:21.997 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:21.998 INFO:tasks.thrashosds.thrasher:Reweighting osd 2 to 0.12191030199508229 2024-09-21T13:59:21.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 0.12191030199508229 2024-09-21T13:59:22.008 INFO:teuthology.orchestra.run.smithi079.stdout:2956 writesame 0x97d418d thru 0x97df3d1 data_size 0x1(0xb245 bytes) 2024-09-21T13:59:22.016 INFO:teuthology.orchestra.run.smithi079.stdout:2957 writesame 0x7d7fd5b thru 0x7d82510 data_size 0x22(0x27b6 bytes) 2024-09-21T13:59:22.027 INFO:teuthology.orchestra.run.smithi079.stdout:2958 write 0x60c0f3c thru 0x60cbc9a (0xad5f bytes) 2024-09-21T13:59:22.044 INFO:teuthology.orchestra.run.smithi079.stdout:2959 punch from 0x7b76422 to 0x7b83e52, (0xda30 bytes) 2024-09-21T13:59:22.044 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.044 INFO:teuthology.orchestra.run.smithi079.stdout:2961 write 0x1af8901 thru 0x1af8b78 (0x278 bytes) 2024-09-21T13:59:22.055 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:22.053+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:22.056 INFO:teuthology.orchestra.run.smithi079.stdout:2963 write 0x83c6d2b thru 0x83c95e2 (0x28b8 bytes) 2024-09-21T13:59:22.065 INFO:teuthology.orchestra.run.smithi079.stdout:2964 read 0x6c598ba thru 0x6c5ab33 (0x127a bytes) 2024-09-21T13:59:22.066 INFO:teuthology.orchestra.run.smithi079.stdout:2965 write 0x582dfe2 thru 0x583001c (0x203b bytes) 2024-09-21T13:59:22.087 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.087 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.103 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:22.111 INFO:teuthology.orchestra.run.smithi079.stdout:2966 punch from 0x4dacb09 to 0x4db4224, (0x771b bytes) 2024-09-21T13:59:22.125 INFO:teuthology.orchestra.run.smithi079.stdout:2967 write 0xde6c7c3 thru 0xde75a96 (0x92d4 bytes) 2024-09-21T13:59:22.131 INFO:teuthology.orchestra.run.smithi079.stdout:2970 read 0x468773 thru 0x46bf2d (0x37bb bytes) 2024-09-21T13:59:22.132 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.132 INFO:teuthology.orchestra.run.smithi079.stdout:2972 read 0x5e4e64d thru 0x5e5c605 (0xdfb9 bytes) 2024-09-21T13:59:22.133 INFO:teuthology.orchestra.run.smithi079.stdout:2975 read 0xba6f4c1 thru 0xba78b28 (0x9668 bytes) 2024-09-21T13:59:22.133 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.133 INFO:teuthology.orchestra.run.smithi079.stdout:2977 trunc from 0xde75a97 to 0xd46b63a 2024-09-21T13:59:22.148 INFO:teuthology.orchestra.run.smithi079.stdout:2978 punch from 0x84e0fe9 to 0x84f0e05, (0xfe1c bytes) 2024-09-21T13:59:22.155 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:22.153+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:22.165 INFO:teuthology.orchestra.run.smithi079.stdout:2979 trunc from 0xd46b63a to 0x185e295 2024-09-21T13:59:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:2980 write 0x4ea48da thru 0x4eb4420 (0xfb47 bytes) 2024-09-21T13:59:22.203 INFO:teuthology.orchestra.run.smithi079.stdout:2981 write 0x2172bb thru 0x219217 (0x1f5d bytes) 2024-09-21T13:59:22.205 INFO:teuthology.orchestra.run.smithi079.stdout:2982 read 0x33d4fc0 thru 0x33e3183 (0xe1c4 bytes) 2024-09-21T13:59:22.206 INFO:teuthology.orchestra.run.smithi079.stdout:2985 read 0x4a6e4bf thru 0x4a78902 (0xa444 bytes) 2024-09-21T13:59:22.214 INFO:teuthology.orchestra.run.smithi079.stdout:2986 trunc from 0x4eb4421 to 0xa7e4032 2024-09-21T13:59:22.232 INFO:teuthology.orchestra.run.smithi079.stdout:2988 trunc from 0xa7e4032 to 0x2c8e975 2024-09-21T13:59:22.241 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.242 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.247 INFO:teuthology.orchestra.run.smithi079.stdout:2989 read 0x216e21b thru 0x2179ea0 (0xbc86 bytes) 2024-09-21T13:59:22.257 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:22.253+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:22.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:22.259 INFO:teuthology.orchestra.run.smithi079.stdout:2990 write 0x600c605 thru 0x60191dc (0xcbd8 bytes) 2024-09-21T13:59:22.262 INFO:teuthology.orchestra.run.smithi079.stdout:2991 write 0x51db1ad thru 0x51e406e (0x8ec2 bytes) 2024-09-21T13:59:22.268 INFO:teuthology.orchestra.run.smithi079.stdout:2993 punch from 0x497d934 to 0x497fedd, (0x25a9 bytes) 2024-09-21T13:59:22.278 INFO:teuthology.orchestra.run.smithi079.stdout:2994 writesame 0x7930b1a thru 0x793feb8 data_size 0x1(0xf39f bytes) 2024-09-21T13:59:22.279 INFO:teuthology.orchestra.run.smithi079.stdout:2995 punch from 0x1cd5a0e to 0x1ce0b02, (0xb0f4 bytes) 2024-09-21T13:59:22.279 INFO:teuthology.orchestra.run.smithi079.stdout:2996 read 0x57f604c thru 0x57f82d5 (0x228a bytes) 2024-09-21T13:59:22.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:59:22.297 INFO:teuthology.orchestra.run.smithi079.stdout:2997 write 0xe8746a9 thru 0xe882177 (0xdacf bytes) 2024-09-21T13:59:22.303 INFO:teuthology.orchestra.run.smithi079.stdout:2998 write 0xcd87708 thru 0xcd96944 (0xf23d bytes) 2024-09-21T13:59:22.309 INFO:teuthology.orchestra.run.smithi079.stdout:2999 read 0x244e866 thru 0x244ef2e (0x6c9 bytes) 2024-09-21T13:59:22.309 INFO:teuthology.orchestra.run.smithi079.stdout:3000 writesame 0x15e4391 thru 0x15ed8b5 data_size 0x59(0x9525 bytes) 2024-09-21T13:59:22.311 INFO:teuthology.orchestra.run.smithi079.stdout:3001 punch from 0x99bdf9 to 0x9aae1b, (0xf022 bytes) 2024-09-21T13:59:22.311 INFO:teuthology.orchestra.run.smithi079.stdout:3002 write 0x5ed79f2 thru 0x5ee6069 (0xe678 bytes) 2024-09-21T13:59:22.313 INFO:teuthology.orchestra.run.smithi079.stdout:3003 read 0xaf7f091 thru 0xaf8e27c (0xf1ec bytes) 2024-09-21T13:59:22.314 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.317 INFO:teuthology.orchestra.run.smithi079.stdout:3006 trunc from 0xe882178 to 0xbb460fb 2024-09-21T13:59:22.334 INFO:teuthology.orchestra.run.smithi079.stdout:3007 read 0x9908a3c thru 0x990f534 (0x6af9 bytes) 2024-09-21T13:59:22.345 INFO:teuthology.orchestra.run.smithi079.stdout:3008 trunc from 0xbb460fb to 0x285bf45 2024-09-21T13:59:22.357 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:22.353+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:22.363 INFO:teuthology.orchestra.run.smithi079.stdout:3009 trunc from 0x285bf45 to 0x374bfa6 2024-09-21T13:59:22.371 INFO:teuthology.orchestra.run.smithi079.stdout:3010 write 0x2269a47 thru 0x226c532 (0x2aec bytes) 2024-09-21T13:59:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:3011 read 0x14c2fce thru 0x14c8091 (0x50c4 bytes) 2024-09-21T13:59:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:3012 punch from 0x15cd68c to 0x15d9d55, (0xc6c9 bytes) 2024-09-21T13:59:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:3015 read 0x3b64d5 thru 0x3b7e6b (0x1997 bytes) 2024-09-21T13:59:22.378 INFO:teuthology.orchestra.run.smithi079.stdout:3016 writesame 0x1676dcc thru 0x16852f5 data_size 0x1(0xe52a bytes) 2024-09-21T13:59:22.386 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.386 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:22.409 INFO:teuthology.orchestra.run.smithi079.stdout:3018 write 0x3642d9e thru 0x364d54e (0xa7b1 bytes) 2024-09-21T13:59:22.431 INFO:teuthology.orchestra.run.smithi079.stdout:3019 write 0x9f68a69 thru 0x9f6e7c8 (0x5d60 bytes) 2024-09-21T13:59:22.435 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.435 INFO:teuthology.orchestra.run.smithi079.stdout:3021 write 0x62dceae thru 0x62dd332 (0x485 bytes) 2024-09-21T13:59:22.437 INFO:teuthology.orchestra.run.smithi079.stdout:3022 punch from 0x5d64cd1 to 0x5d6f836, (0xab65 bytes) 2024-09-21T13:59:22.438 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.445 INFO:teuthology.orchestra.run.smithi079.stdout:3024 write 0xa5d389a thru 0xa5da07a (0x67e1 bytes) 2024-09-21T13:59:22.450 INFO:teuthology.orchestra.run.smithi079.stdout:3026 read 0x76f8e94 thru 0x7705676 (0xc7e3 bytes) 2024-09-21T13:59:22.451 INFO:teuthology.orchestra.run.smithi079.stdout:3027 write 0x4fb12ac thru 0x4fb69f1 (0x5746 bytes) 2024-09-21T13:59:22.458 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:22.453+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:22.460 INFO:teuthology.orchestra.run.smithi079.stdout:3029 write 0xaae444b thru 0xaaed28b (0x8e41 bytes) 2024-09-21T13:59:22.475 INFO:teuthology.orchestra.run.smithi079.stdout:3030 write 0xbbcb7d0 thru 0xbbdb728 (0xff59 bytes) 2024-09-21T13:59:22.481 INFO:teuthology.orchestra.run.smithi079.stdout:3033 punch from 0x94f80c to 0x950bf6, (0x13ea bytes) 2024-09-21T13:59:22.481 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.481 INFO:teuthology.orchestra.run.smithi079.stdout:3038 read 0x4d92366 thru 0x4d95fd0 (0x3c6b bytes) 2024-09-21T13:59:22.481 INFO:teuthology.orchestra.run.smithi079.stdout:3039 read 0x2801192 thru 0x280c6f9 (0xb568 bytes) 2024-09-21T13:59:22.494 INFO:teuthology.orchestra.run.smithi079.stdout:3042 trunc from 0xbbdb729 to 0x1dbc7d2 2024-09-21T13:59:22.533 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.534 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.546 INFO:teuthology.orchestra.run.smithi079.stdout:3043 write 0xdd713d0 thru 0xdd7a376 (0x8fa7 bytes) 2024-09-21T13:59:22.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:22.552 INFO:teuthology.orchestra.run.smithi079.stdout:3044 read 0x4bb5493 thru 0x4bc383f (0xe3ad bytes) 2024-09-21T13:59:22.562 INFO:teuthology.orchestra.run.smithi079.stdout:3046 trunc from 0xdd7a377 to 0x663a1ce 2024-09-21T13:59:22.562 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:22.557+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:22.585 INFO:teuthology.orchestra.run.smithi079.stdout:3047 trunc from 0x663a1ce to 0x8fcaf1f 2024-09-21T13:59:22.593 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.593 INFO:teuthology.orchestra.run.smithi079.stdout:3049 punch from 0x381b25c to 0x382083b, (0x55df bytes) 2024-09-21T13:59:22.593 INFO:teuthology.orchestra.run.smithi079.stdout:3050 write 0x6e11469 thru 0x6e1d368 (0xbf00 bytes) 2024-09-21T13:59:22.604 INFO:teuthology.orchestra.run.smithi079.stdout:3051 trunc from 0x8fcaf1f to 0x1b66260 2024-09-21T13:59:22.613 INFO:teuthology.orchestra.run.smithi079.stdout:3053 read 0x8a8242 thru 0x8b7482 (0xf241 bytes) 2024-09-21T13:59:22.614 INFO:teuthology.orchestra.run.smithi079.stdout:3054 read 0x169fc6f thru 0x169fde4 (0x176 bytes) 2024-09-21T13:59:22.614 INFO:teuthology.orchestra.run.smithi079.stdout:3055 read 0x58e90f thru 0x597eda (0x95cc bytes) 2024-09-21T13:59:22.634 INFO:teuthology.orchestra.run.smithi079.stdout:3056 writesame 0xaf2c3cc thru 0xaf34301 data_size 0x13(0x7f36 bytes) 2024-09-21T13:59:22.637 INFO:teuthology.orchestra.run.smithi079.stdout:3057 trunc from 0xaf34302 to 0xd0b985f 2024-09-21T13:59:22.646 INFO:teuthology.orchestra.run.smithi079.stdout:3060 trunc from 0xd0b985f to 0xbfd6847 2024-09-21T13:59:22.659 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:22.657+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:22.661 INFO:teuthology.orchestra.run.smithi079.stdout:3062 trunc from 0xbfd6847 to 0x5c860d6 2024-09-21T13:59:22.673 INFO:teuthology.orchestra.run.smithi079.stdout:3063 write 0x3b44442 thru 0x3b47d3d (0x38fc bytes) 2024-09-21T13:59:22.675 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.675 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:3065 write 0xeb1fd72 thru 0xeb20b12 (0xda1 bytes) 2024-09-21T13:59:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:3066 read 0x957003b thru 0x957d6e3 (0xd6a9 bytes) 2024-09-21T13:59:22.704 INFO:teuthology.orchestra.run.smithi079.stdout:3068 read 0xd1efd9e thru 0xd1f9a21 (0x9c84 bytes) 2024-09-21T13:59:22.705 INFO:teuthology.orchestra.run.smithi079.stdout:3069 read 0xbf8cf0d thru 0xbf9c79b (0xf88f bytes) 2024-09-21T13:59:22.724 INFO:teuthology.orchestra.run.smithi079.stdout:3072 trunc from 0xeb20b13 to 0x8e8239 2024-09-21T13:59:22.760 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:22.757+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:22.773 INFO:teuthology.orchestra.run.smithi079.stdout:3073 write 0xae0cf30 thru 0xae10ea1 (0x3f72 bytes) 2024-09-21T13:59:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:3074 write 0xed02d38 thru 0xed12c65 (0xff2e bytes) 2024-09-21T13:59:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:3076 punch from 0xae73e0b to 0xae7d686, (0x987b bytes) 2024-09-21T13:59:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:3077 punch from 0x6d405bc to 0x6d4884f, (0x8293 bytes) 2024-09-21T13:59:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:3079 punch from 0x7dcfeb6 to 0x7dd5c7b, (0x5dc5 bytes) 2024-09-21T13:59:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:3081 writesame 0x6976995 thru 0x6980776 data_size 0x7(0x9de2 bytes) 2024-09-21T13:59:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:3082 read 0x3b7ddc thru 0x3c6f2a (0xf14f bytes) 2024-09-21T13:59:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:3083 punch from 0x5651465 to 0x56558b6, (0x4451 bytes) 2024-09-21T13:59:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:3084 write 0x7a3edd1 thru 0x7a4e924 (0xfb54 bytes) 2024-09-21T13:59:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:3086 read 0xccb02bd thru 0xccbc309 (0xc04d bytes) 2024-09-21T13:59:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.827 INFO:teuthology.orchestra.run.smithi079.stdout:3088 trunc from 0xed12c66 to 0x7a5a785 2024-09-21T13:59:22.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.852 INFO:teuthology.orchestra.run.smithi079.stdout:3090 trunc from 0x7a5a785 to 0x850abf2 2024-09-21T13:59:22.860 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:22.857+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:3092 write 0x1fc05b0 thru 0x1fc5bc5 (0x5616 bytes) 2024-09-21T13:59:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:3093 punch from 0x2c28648 to 0x2c3627b, (0xdc33 bytes) 2024-09-21T13:59:22.873 INFO:teuthology.orchestra.run.smithi079.stdout:3094 write 0x8dae7cb thru 0x8db1d14 (0x354a bytes) 2024-09-21T13:59:22.879 INFO:teuthology.orchestra.run.smithi079.stdout:3095 read 0x302aee1 thru 0x30319b3 (0x6ad3 bytes) 2024-09-21T13:59:22.893 INFO:teuthology.orchestra.run.smithi079.stdout:3096 write 0xdaaf0cf thru 0xdab7f76 (0x8ea8 bytes) 2024-09-21T13:59:22.899 INFO:teuthology.orchestra.run.smithi079.stdout:3097 write 0xc52a9b6 thru 0xc532aed (0x8138 bytes) 2024-09-21T13:59:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:3098 read 0xbf7cd55 thru 0xbf83232 (0x64de bytes) 2024-09-21T13:59:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:3099 write 0xcc98aa6 thru 0xcca76cd (0xec28 bytes) 2024-09-21T13:59:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:3101 punch from 0xcacf1cd to 0xcacf7d9, (0x60c bytes) 2024-09-21T13:59:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:3102 write 0x5573b80 thru 0x5581eb3 (0xe334 bytes) 2024-09-21T13:59:22.913 INFO:teuthology.orchestra.run.smithi079.stdout:3103 writesame 0xa117a17 thru 0xa124792 data_size 0x2(0xcd7c bytes) 2024-09-21T13:59:22.938 INFO:teuthology.orchestra.run.smithi079.stdout:3105 read 0x68c364b thru 0x68c636c (0x2d22 bytes) 2024-09-21T13:59:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:3106 write 0xe2f41eb thru 0xe2f9d3e (0x5b54 bytes) 2024-09-21T13:59:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:3107 read 0xb1d0294 thru 0xb1dbd8c (0xbaf9 bytes) 2024-09-21T13:59:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:3108 read 0xa5762f9 thru 0xa582155 (0xbe5d bytes) 2024-09-21T13:59:22.954 INFO:teuthology.orchestra.run.smithi079.stdout:3110 write 0xdc32a67 thru 0xdc3cc81 (0xa21b bytes) 2024-09-21T13:59:22.957 INFO:teuthology.orchestra.run.smithi079.stdout:3111 punch from 0xa19a4d3 to 0xa19e863, (0x4390 bytes) 2024-09-21T13:59:22.961 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:22.957+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:3115 trunc from 0xe2f9d3f to 0x93f630f 2024-09-21T13:59:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:22.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:23.001 INFO:teuthology.orchestra.run.smithi079.stdout:3116 write 0xe715109 thru 0xe720181 (0xb079 bytes) 2024-09-21T13:59:23.006 INFO:teuthology.orchestra.run.smithi079.stdout:3117 writesame 0xa012f9d thru 0xa01c84a data_size 0x1(0x98ae bytes) 2024-09-21T13:59:23.030 INFO:teuthology.orchestra.run.smithi079.stdout:3119 write 0x50a1861 thru 0x50ac40c (0xabac bytes) 2024-09-21T13:59:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:3121 write 0x9db567d thru 0x9db7846 (0x21ca bytes) 2024-09-21T13:59:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:3122 writesame 0x34fef2a thru 0x3508d25 data_size 0x2(0x9dfc bytes) 2024-09-21T13:59:23.061 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:23.057+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:23.066 INFO:teuthology.orchestra.run.smithi079.stdout:3123 read 0x356c5c4 thru 0x3579514 (0xcf51 bytes) 2024-09-21T13:59:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:23.086 INFO:teuthology.orchestra.run.smithi079.stdout:3128 trunc from 0xe720182 to 0x3472cc3 2024-09-21T13:59:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.118 INFO:teuthology.orchestra.run.smithi079.stdout:3129 read 0x1a7225d thru 0x1a7e300 (0xc0a4 bytes) 2024-09-21T13:59:23.119 INFO:teuthology.orchestra.run.smithi079.stdout:3130 write 0xc4d652 thru 0xc5b749 (0xe0f8 bytes) 2024-09-21T13:59:23.122 INFO:teuthology.orchestra.run.smithi079.stdout:3131 read 0x2757fca thru 0x275818b (0x1c2 bytes) 2024-09-21T13:59:23.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:3132 writesame 0x677f7d1 thru 0x678b0d5 data_size 0x1(0xb905 bytes) 2024-09-21T13:59:23.141 INFO:teuthology.orchestra.run.smithi079.stdout:3133 writesame 0x5495aa4 thru 0x5495db7 data_size 0x1(0x314 bytes) 2024-09-21T13:59:23.147 INFO:teuthology.orchestra.run.smithi079.stdout:3135 write 0x307ce78 thru 0x307d4e4 (0x66d bytes) 2024-09-21T13:59:23.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:23.157+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:3136 writesame 0xd9b6367 thru 0xd9b7b1b data_size 0x15(0x17b5 bytes) 2024-09-21T13:59:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:3137 write 0x50e788b thru 0x50f1b20 (0xa296 bytes) 2024-09-21T13:59:23.170 INFO:teuthology.orchestra.run.smithi079.stdout:3139 write 0xc5cb0b2 thru 0xc5d073e (0x568d bytes) 2024-09-21T13:59:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:3140 read 0x578dee8 thru 0x57965b6 (0x86cf bytes) 2024-09-21T13:59:23.178 INFO:teuthology.orchestra.run.smithi079.stdout:3141 read 0x25acce6 thru 0x25b80f8 (0xb413 bytes) 2024-09-21T13:59:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:3142 write 0x77ea3f5 thru 0x77f7e47 (0xda53 bytes) 2024-09-21T13:59:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:3143 writesame 0xe22c48b thru 0xe2320b3 data_size 0x1(0x5c29 bytes) 2024-09-21T13:59:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:3144 write 0xacf73cb thru 0xad02330 (0xaf66 bytes) 2024-09-21T13:59:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:3145 read 0xa44961c thru 0xa44f5c8 (0x5fad bytes) 2024-09-21T13:59:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:3146 read 0x2822b32 thru 0x282a6c5 (0x7b94 bytes) 2024-09-21T13:59:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:3147 read 0x1a5e159 thru 0x1a6c2fe (0xe1a6 bytes) 2024-09-21T13:59:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:3149 write 0x89c4e47 thru 0x89cf333 (0xa4ed bytes) 2024-09-21T13:59:23.197 INFO:teuthology.orchestra.run.smithi079.stdout:3150 read 0xb1436d2 thru 0xb1458e4 (0x2213 bytes) 2024-09-21T13:59:23.198 INFO:teuthology.orchestra.run.smithi079.stdout:3151 read 0x2375c7c thru 0x23823d7 (0xc75c bytes) 2024-09-21T13:59:23.207 INFO:teuthology.orchestra.run.smithi079.stdout:3152 trunc from 0xe2320b4 to 0x7c64b61 2024-09-21T13:59:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:3153 write 0xad795fe thru 0xad7c96d (0x3370 bytes) 2024-09-21T13:59:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:3154 write 0x4b66a98 thru 0x4b703bd (0x9926 bytes) 2024-09-21T13:59:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:59:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.2 to 0.12191 (1f35) 2024-09-21T13:59:23.258 INFO:teuthology.orchestra.run.smithi079.stdout:3155 write 0x1b88adc thru 0x1b949bc (0xbee1 bytes) 2024-09-21T13:59:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.264 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:23.261+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:23.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:23.365 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:23.361+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:23.439 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.439 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:23.499 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:23.497+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:23.566 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:23.561+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:23.667 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:23.665+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:23.761 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.762 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.768 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:23.765+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:23.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:23.869 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:23.865+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:23.906 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:23.906 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:23.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:23.970 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:23.969+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:23.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:24.070 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:24.065+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:24.078 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:24.078 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:24.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:24.129 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:24.129 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:24.145 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:24.145 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:24.161 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:24.161 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:24.171 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:24.169+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:24.176 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:24.177 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:24.195 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:24.195 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:24.212 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:24.212 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:24.213 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63683 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8607744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400598576, 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532036000000005, 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63683 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810762+0000", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810761+0000", 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810766+0000", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810778+0000", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970000000000001e-05 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810786+0000", 2024-09-21T13:59:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8760000000000005e-06 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879128+0000", 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068342585999999997 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879212+0000", 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3610999999999996e-05 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879294+0000", 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1790000000000001e-05 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63684 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8818688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400528917000003, 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068734580000000003, 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63684 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810831+0000", 2024-09-21T13:59:24.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810830+0000", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810835+0000", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3800000000000004e-06 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810845+0000", 2024-09-21T13:59:24.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.059e-05 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810853+0000", 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5870000000000004e-06 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879348+0000", 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068494909000000007 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879462+0000", 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114113 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879566+0000", 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103948 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63685 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8624128~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:24.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400426340999999, 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068952380999999993, 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63685 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810934+0000", 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810933+0000", 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810937+0000", 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.777e-06 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810946+0000", 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5100000000000004e-06 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.810953+0000", 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9759999999999998e-06 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879637+0000", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068684000999999995 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879746+0000", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010861699999999999 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879886+0000", 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014020699999999999 2024-09-21T13:59:24.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63686 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8835072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400296072000003, 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069139377000000002, 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.227 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63686 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811064+0000", 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811063+0000", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811068+0000", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0900000000000004e-06 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811080+0000", 2024-09-21T13:59:24.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2065999999999999e-05 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811088+0000", 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0669999999999992e-06 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.879940+0000", 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068851865999999998 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880078+0000", 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137825 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880204+0000", 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012537299999999999 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63687 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8640512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.231 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400228882999997, 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069385890000000006, 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63687 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:24.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811131+0000", 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811130+0000", 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811135+0000", 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5730000000000001e-06 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811159+0000", 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4443999999999998e-05 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811167+0000", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9300000000000003e-06 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880255+0000", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069087899999999994 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880395+0000", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014011000000000001 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880517+0000", 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012190599999999999 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63688 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8851456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.400122916999997, 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069594696999999997, 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63688 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811237+0000", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811241+0000", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8929999999999998e-06 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811253+0000", 2024-09-21T13:59:24.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2490000000000001e-05 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811260+0000", 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880566+0000", 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069305781999999996 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880700+0000", 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013418100000000001 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880832+0000", 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131784 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63689 3.1a 3:5ba7ea92:::rbd_data.11853c86949e.0000000000000002:a [read 8656896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399968407999999, 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069737959000000002, 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63689 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:24.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811392+0000", 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811391+0000", 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811396+0000", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2900000000000002e-06 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811414+0000", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7730000000000001e-05 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811425+0000", 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1426999999999999e-05 2024-09-21T13:59:24.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.880888+0000", 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069462504999999994 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881001+0000", 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112864 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881130+0000", 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012915999999999999 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63690 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399913832000003, 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069766482000000005, 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63690 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:24.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811446+0000", 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811450+0000", 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0799999999999999e-06 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811459+0000", 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7030000000000001e-06 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811467+0000", 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1060000000000002e-06 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881193+0000", 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069726423999999995 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881213+0000", 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9922e-05 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63691 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399814415999998, 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069718315000000003, 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63691 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811546+0000", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811545+0000", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811549+0000", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.58e-06 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811559+0000", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811566+0000", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4170000000000003e-06 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881251+0000", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069684595000000002 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881264+0000", 2024-09-21T13:59:24.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63692 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399670290000003, 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069651563, 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63692 2024-09-21T13:59:24.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811690+0000", 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811689+0000", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811694+0000", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811708+0000", 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3246e-05 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811730+0000", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2399999999999999e-05 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881326+0000", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595516999999996 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881341+0000", 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5857000000000001e-05 2024-09-21T13:59:24.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63693 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399606961000003, 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069650701999999995, 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.257 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63693 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811753+0000", 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811752+0000", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811757+0000", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0429999999999998e-06 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811769+0000", 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-09-21T13:59:24.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811776+0000", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3730000000000004e-06 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881392+0000", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069615125 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881404+0000", 2024-09-21T13:59:24.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2367e-05 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63694 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399507434999997, 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069626173, 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63694 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811853+0000", 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811852+0000", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811856+0000", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.856e-06 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811866+0000", 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6299999999999993e-06 2024-09-21T13:59:24.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811873+0000", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9670000000000004e-06 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881460+0000", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069587684999999996 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881479+0000", 2024-09-21T13:59:24.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8678e-05 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63695 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399363815999997, 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069547126000000001, 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63695 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811996+0000", 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.811995+0000", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812001+0000", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1429999999999997e-06 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812013+0000", 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2017e-05 2024-09-21T13:59:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812021+0000", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9959999999999993e-06 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881531+0000", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069510752999999995 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881544+0000", 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2267e-05 2024-09-21T13:59:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63696 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399319353000003, 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069576064000000007, 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63696 2024-09-21T13:59:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812041+0000", 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812040+0000", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812044+0000", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2729999999999996e-06 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812059+0000", 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.489e-05 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812067+0000", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4900000000000003e-06 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881598+0000", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069531573999999999 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881617+0000", 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.857e-05 2024-09-21T13:59:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63697 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399205274000003, 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069523260000000003, 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63697 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812155+0000", 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812154+0000", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812158+0000", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.783e-06 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812171+0000", 2024-09-21T13:59:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2573e-05 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812178+0000", 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881667+0000", 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069489372999999993 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881678+0000", 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0964e-05 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63698 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.399069975000003, 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069463332000000003, 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63698 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812290+0000", 2024-09-21T13:59:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812289+0000", 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812294+0000", 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9439999999999996e-06 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812317+0000", 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2566e-05 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812325+0000", 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2800000000000003e-06 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881734+0000", 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069408436000000004 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881754+0000", 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0032999999999999e-05 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63699 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.398764036999999, 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069222506000000003, 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63699 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812596+0000", 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812345+0000", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997487 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812601+0000", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025618499999999997 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812617+0000", 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.588e-05 2024-09-21T13:59:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812626+0000", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3960000000000006e-06 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881807+0000", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069181189000000004 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881819+0000", 2024-09-21T13:59:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1980999999999999e-05 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63700 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.398433937, 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068967141999999995, 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63700 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812926+0000", 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812646+0000", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997196 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812931+0000", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028525499999999999 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812944+0000", 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2356e-05 2024-09-21T13:59:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812952+0000", 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881875+0000", 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068923456999999994 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881893+0000", 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051e-05 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63701 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.398145495000001, 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068737086000000003, 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63701 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813215+0000", 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.812959+0000", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997444 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813219+0000", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026008200000000002 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813231+0000", 2024-09-21T13:59:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2063e-05 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813250+0000", 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.842e-05 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881940+0000", 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068690141999999996 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881952+0000", 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1970999999999999e-05 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:63702 3.1a 3.4957e5da (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.397891377000001, 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068532663999999993, 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 63702 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813469+0000", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813257+0000", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997888 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813473+0000", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021604799999999999 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813486+0000", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2277e-05 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.813494+0000", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0399999999999993e-06 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.881991+0000", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068497604000000004 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.882002+0000", 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0166999999999999e-05 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.297 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:24.298 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:24.299 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:24.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:24.299 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:24.297+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:24.300 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:24.399 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:24.397+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:24.468 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:24.468 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:24.468 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:24.468 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:24.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:24.499 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:24.496+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:24.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:24.596+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:24.606 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:24.606 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:24.606 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:24.606 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:24.606 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:24.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:24.701 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:24.697+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64133 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10911744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903664005000003, 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069056558000000004, 2024-09-21T13:59:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64133 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838060+0000", 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838062+0000", 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4899999999999999e-06 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838070+0000", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5639999999999999e-06 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838083+0000", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2713e-05 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906781+0000", 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068698555999999994 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.906938+0000", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015647400000000001 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907117+0000", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017901899999999999 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64134 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10733568~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903637693, 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069333364999999994, 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64134 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838086+0000", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838088+0000", 2024-09-21T13:59:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1160000000000002e-06 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838093+0000", 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8659999999999997e-06 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838098+0000", 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8189999999999999e-06 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907174+0000", 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069075937000000004 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907295+0000", 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121527 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907420+0000", 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124387 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64135 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10928128~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903621012000002, 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069595481000000001, 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64135 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838103+0000", 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838105+0000", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838115+0000", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4180000000000003e-06 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838120+0000", 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0200000000000002e-06 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907465+0000", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069345748999999998 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907550+0000", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4190999999999994e-05 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907699+0000", 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014886599999999999 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64136 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10749952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903600589, 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069879827000000005, 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64136 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838123+0000", 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838125+0000", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838132+0000", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.798e-06 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838137+0000", 2024-09-21T13:59:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3550000000000004e-06 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907777+0000", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069639767000000005 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.907881+0000", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103658 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908003+0000", 2024-09-21T13:59:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122578 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64137 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10944512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903508719999998, 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070170959000000005, 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64137 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838215+0000", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838218+0000", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9430000000000002e-06 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838230+0000", 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838239+0000", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6680000000000007e-06 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908053+0000", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069814478999999999 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908197+0000", 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143948 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908386+0000", 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018891200000000001 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64138 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10766336~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903463936999998, 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070426890000000006, 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64138 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838260+0000", 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838259+0000", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838264+0000", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4680000000000003e-06 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838274+0000", 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7159999999999998e-06 2024-09-21T13:59:24.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838281+0000", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.968e-06 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908460+0000", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070179149999999996 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908561+0000", 2024-09-21T13:59:24.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101364 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908687+0000", 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012597800000000001 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64139 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10960896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.903437404999998, 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070767155999999998, 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64139 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838287+0000", 2024-09-21T13:59:24.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838286+0000", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838289+0000", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838297+0000", 2024-09-21T13:59:24.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0649999999999999e-06 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838304+0000", 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4330000000000001e-06 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908754+0000", 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070449759000000001 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.908904+0000", 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150168 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909054+0000", 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015012900000000001 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64140 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10782720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.902973416999998, 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070604650000000005, 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64140 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838751+0000", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838309+0000", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999558 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838772+0000", 2024-09-21T13:59:24.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046326800000000002 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838784+0000", 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1932e-05 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838792+0000", 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1640000000000001e-06 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909106+0000", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070314146999999994 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909226+0000", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001197 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909355+0000", 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000129412 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.777 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64141 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10977280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.902461330999998, 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070343271999999998, 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64141 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839263+0000", 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.838799+0000", 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995365 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839267+0000", 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046808499999999997 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839278+0000", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0943e-05 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839287+0000", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3259999999999996e-06 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909412+0000", 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070125259999999995 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909493+0000", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1191000000000002e-05 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909606+0000", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113001 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64142 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10799104~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:24.782 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.902080632999997, 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070248221, 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64142 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839643+0000", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839294+0000", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.99965 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839648+0000", 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035480400000000001 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839658+0000", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6080000000000002e-06 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839663+0000", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.074e-06 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909646+0000", 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069982588999999998 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909769+0000", 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012363200000000001 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909892+0000", 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122342 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64143 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10993664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.786 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.901648696999999, 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070150836999999994, 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64143 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840075+0000", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.839681+0000", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996057 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840080+0000", 2024-09-21T13:59:24.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000399341 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840091+0000", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0694e-05 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840099+0000", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3240000000000003e-06 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.909939+0000", 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069839335000000002 2024-09-21T13:59:24.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910038+0000", 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9512999999999994e-05 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910226+0000", 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018791599999999999 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64144 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10815488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.901075065000001, 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069887875000000002, 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64144 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840649+0000", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840121+0000", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994721 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840653+0000", 2024-09-21T13:59:24.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00053217200000000003 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840662+0000", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2600000000000005e-06 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840670+0000", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4740000000000005e-06 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910299+0000", 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069628667000000005 2024-09-21T13:59:24.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910405+0000", 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105778 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910537+0000", 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132199 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64145 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10831872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.900637492000001, 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069831590999999998, 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64145 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841087+0000", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.840703+0000", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996161 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841092+0000", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038957299999999999 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841101+0000", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6840000000000002e-06 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841108+0000", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910605+0000", 2024-09-21T13:59:24.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069497009999999998 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910760+0000", 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015446000000000001 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910918+0000", 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015825299999999999 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64146 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10489856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.900091709000002, 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069574639999999993, 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64146 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841632+0000", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841132+0000", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9994998 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841637+0000", 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00050520100000000004 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841645+0000", 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8949999999999998e-06 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841652+0000", 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3620000000000002e-06 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.910965+0000", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069313079 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911082+0000", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116834 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911207+0000", 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125365 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64147 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10848256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.899762246000002, 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069517756999999999, 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64147 2024-09-21T13:59:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841962+0000", 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841659+0000", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996972 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841967+0000", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030764399999999998 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841976+0000", 2024-09-21T13:59:24.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6909999999999992e-06 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.841984+0000", 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0059999999999992e-06 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911268+0000", 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069284088999999993 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911365+0000", 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6559999999999997e-05 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911480+0000", 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011451399999999999 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64148 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10506240~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.899331842000002, 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069398185000000001, 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64148 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842392+0000", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842030+0000", 2024-09-21T13:59:24.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9996371 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842397+0000", 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036758100000000002 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842408+0000", 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0438999999999999e-05 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842416+0000", 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1349999999999992e-06 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911554+0000", 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069138738000000005 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911667+0000", 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112936 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911790+0000", 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122996 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64149 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10864640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.898826155000002, 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069236906000000001, 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64149 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842898+0000", 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842447+0000", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995494 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842903+0000", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045564299999999999 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842913+0000", 2024-09-21T13:59:24.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0193999999999999e-05 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842921+0000", 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.14e-06 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911840+0000", 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068918980000000005 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.911943+0000", 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010306600000000001 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912135+0000", 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019169 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64150 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10522624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:24.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.898333645999998, 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069209838999999995, 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64150 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843390+0000", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.842929+0000", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9995384 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843395+0000", 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00046669300000000001 2024-09-21T13:59:24.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843407+0000", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1262e-05 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.843415+0000", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2609999999999993e-06 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912299+0000", 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068884538999999995 2024-09-21T13:59:24.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912456+0000", 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015631900000000001 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.912600+0000", 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014456899999999999 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64165 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10995712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.892879137000001, 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069022151000000004, 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64165 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848845+0000", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848844+0000", 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848850+0000", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2319999999999998e-06 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848864+0000", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.377e-05 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.848876+0000", 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2396e-05 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917682+0000", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068805955000000002 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917762+0000", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9967000000000002e-05 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.917867+0000", 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104956 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:64167 3.5 3:a157922f:::rbd_data.11853c86949e.0000000000000001:a [read 10491904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.892231815000002, 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069104480999999995, 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 64167 2024-09-21T13:59:24.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849492+0000", 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:24.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849491+0000", 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849495+0000", 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3749999999999999e-06 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849502+0000", 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2749999999999998e-06 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.849508+0000", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9100000000000002e-06 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918416+0000", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068908419999999998 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918494+0000", 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7570000000000004e-05 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:24.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:47.918597+0000", 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102673 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:24.829 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:24.831 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:24.831 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:24.829+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:24.932 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:24.932+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:25.000 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:25.000 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:25.014 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:25.059 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:25.057+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:25.133 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:25.133 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:25.133 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:25.133 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:25.133 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:25.134 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:25.129+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:25.147 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:25.235 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:25.233+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:25.283 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:59:25.305 INFO:teuthology.orchestra.run.smithi079.stdout:3156 writesame 0xd0733d6 thru 0xd077edd data_size 0x38(0x4b08 bytes) 2024-09-21T13:59:25.306 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:25.306 INFO:teuthology.orchestra.run.smithi079.stdout:3160 writesame 0x23ff066 thru 0x2402931 data_size 0xa(0x38cc bytes) 2024-09-21T13:59:25.322 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:25.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.445339879000002, 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:25.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.437462715999999, 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:25.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.329 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:25.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:25.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:25.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433525693999997, 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:25.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:25.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433514485000003, 2024-09-21T13:59:25.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:25.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433503313000003, 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:25.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433489010000002, 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:25.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433453550000003, 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:25.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433440386999997, 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:25.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:25.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.433428855999999, 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:25.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429440888000002, 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:25.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429421255999998, 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:25.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:25.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429396427999997, 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429371431, 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:25.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:25.381 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429359361000003, 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:25.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:25.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429348040999997, 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:25.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429336900000003, 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:25.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:25.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:25.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429324598999997, 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:25.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.429313346999997, 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:25.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.353243595000002, 2024-09-21T13:59:25.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:25.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:25.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:25.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.344017018999999, 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:25.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:25.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:25.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:25.413 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:25.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3161 trunc from 0xd077ede to 0x9b4974 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3162 punch from 0x4aef02 to 0x4b6e45, (0x7f43 bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3163 write 0x2fd3125 thru 0x2fd540e (0x22ea bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3164 read 0x1c88b3b thru 0x1c88e98 (0x35e bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3166 write 0x4bf0335 thru 0x4bff04f (0xed1b bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3167 read 0xb125ef thru 0xb21df0 (0xf802 bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:3169 read 0x3847388 thru 0x3853f86 (0xcbff bytes) 2024-09-21T13:59:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:25.417 INFO:teuthology.orchestra.run.smithi079.stdout:3171 writesame 0x19c89d7 thru 0x19d28b2 data_size 0x6(0x9edc bytes) 2024-09-21T13:59:25.417 INFO:teuthology.orchestra.run.smithi079.stdout:3172 trunc from 0x4bff050 to 0x4b50fb7 2024-09-21T13:59:25.417 INFO:teuthology.orchestra.run.smithi079.stdout:3173 clone 24 order 20 su 65536 sc 4 2024-09-21T13:59:25.417 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:25.408+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:25.516 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:25.513+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:25.543 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:25.543 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:25.543 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:25.543 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:25.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:25.616 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:25.612+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:25.686 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:25.687 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:25.687 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:25.687 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:25.687 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:25.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:25.744 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:25.740+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:25.818 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:25.813+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:25.868 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.260162909000002, 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:25.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:25.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126316 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 227328~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328727908000001, 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050221382000000002, 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126316 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:25.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537487+0000", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537492+0000", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1080000000000003e-06 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537495+0000", 2024-09-21T13:59:25.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1480000000000002e-06 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537497+0000", 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3250000000000002e-06 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587474+0000", 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049977374999999997 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587563+0000", 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8508e-05 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587709+0000", 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146129 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126317 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 247808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.32871626, 2024-09-21T13:59:25.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050473885000000003, 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126317 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537504+0000", 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7729999999999999e-06 2024-09-21T13:59:25.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537509+0000", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5319999999999997e-06 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537512+0000", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4729999999999999e-06 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587758+0000", 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050246489999999998 2024-09-21T13:59:25.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587848+0000", 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9950000000000004e-05 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587973+0000", 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012499700000000001 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126369 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328699739000001, 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050784915, 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126369 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537515+0000", 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537517+0000", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.984e-06 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537524+0000", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537533+0000", 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9360000000000005e-06 2024-09-21T13:59:25.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587999+0000", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050466364999999999 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588044+0000", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5015999999999997e-05 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588301+0000", 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025690000000000001 2024-09-21T13:59:25.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126370 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 30720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328678926999999, 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050926705000000003, 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126370 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537536+0000", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537538+0000", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537544+0000", 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4689999999999996e-06 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537548+0000", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588328+0000", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050779457 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588384+0000", 2024-09-21T13:59:25.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6156999999999998e-05 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588463+0000", 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9390999999999999e-05 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126371 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328663407000001, 2024-09-21T13:59:25.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051068768, 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126371 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537554+0000", 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9719999999999999e-06 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537559+0000", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537564+0000", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4399999999999998e-06 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588488+0000", 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050924687000000003 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588551+0000", 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2268999999999996e-05 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588621+0000", 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0227000000000004e-05 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126372 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328648192999999, 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051259907, 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126372 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537569+0000", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9910000000000001e-06 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537575+0000", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7570000000000001e-06 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537579+0000", 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3649999999999997e-06 2024-09-21T13:59:25.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588646+0000", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051067250000000002 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588712+0000", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5172000000000006e-05 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588827+0000", 2024-09-21T13:59:25.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011572 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126373 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328632293999998, 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051569028000000003, 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126373 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537585+0000", 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.852e-06 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537591+0000", 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.728e-06 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537595+0000", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588853+0000", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051257748999999998 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588909+0000", 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6140000000000001e-05 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589152+0000", 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000243432 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328617169000001, 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:25.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:25.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328601801000001, 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:25.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328586650999998, 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:25.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:25.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.328551138000002, 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141000 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 431104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982938060999999, 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050082146000000001, 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141000 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883277+0000", 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883280+0000", 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.34e-06 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883287+0000", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.559e-06 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883292+0000", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8690000000000003e-06 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933051+0000", 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049758720999999999 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933129+0000", 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8677999999999994e-05 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933360+0000", 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000230354 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141001 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982919438, 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050465547999999999, 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141001 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:25.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883298+0000", 2024-09-21T13:59:25.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883306+0000", 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4150000000000002e-06 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883310+0000", 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933440+0000", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050129114000000002 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933522+0000", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2812000000000006e-05 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933762+0000", 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023933900000000001 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141002 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 441344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982900882999999, 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050811505999999999, 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141002 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.930 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883314+0000", 2024-09-21T13:59:25.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883317+0000", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.323e-06 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883323+0000", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2389999999999999e-06 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883330+0000", 2024-09-21T13:59:25.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1080000000000004e-06 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933791+0000", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050460855999999998 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933869+0000", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8596000000000004e-05 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934126+0000", 2024-09-21T13:59:25.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025674500000000001 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141003 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982881129999999, 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051137289000000002, 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141003 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883336+0000", 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883344+0000", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-06 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883349+0000", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8250000000000004e-06 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934156+0000", 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050807057000000003 2024-09-21T13:59:25.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934234+0000", 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7729000000000001e-05 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934472+0000", 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023826899999999999 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.939 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141004 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 451584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982862700999998, 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.05147119, 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141004 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:25.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883355+0000", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2340000000000001e-06 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883362+0000", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4189999999999996e-06 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883367+0000", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934501+0000", 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051133396999999997 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934579+0000", 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7818999999999995e-05 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934824+0000", 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024550599999999999 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.943 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.982844133, 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:25.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:25.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.312821493, 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T13:59:25.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T13:59:25.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T13:59:25.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.311493783, 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T13:59:25.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:25.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:25.959 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:25.961 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:25.961 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:25.956+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:26.062 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:26.056+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:26.135 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:26.135 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:26.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:26.163 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:26.161+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:26.263 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:26.260+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:26.277 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:59:26.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:26.328 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:26.328 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:26.328 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:26.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:26.364 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:26.361+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:26.459 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:26.460 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:26.465 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:26.460+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:26.477 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:26.478 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:26.495 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:26.509 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:26.509 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:26.512 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:26.512 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:26.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:26.532 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:26.532 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:26.553 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:26.554 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:26.566 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:26.561+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:26.572 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:26.573 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:26.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:26.578 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:26.650 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:26.650 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:26.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:26.667 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:26.660+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:26.767 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:26.765+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:26.784 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:26.784 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:26.798 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:26.868 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:26.864+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:26.918 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:26.918 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:26.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:26.969 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:26.965+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:27.070 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:27.064+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:27.100 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.100 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:27.203 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:27.200+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:27.283 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.283 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.292 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:27.268+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:27.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:27.373 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:27.369+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:27.472 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.472 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.473 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:27.469+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:27.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:27.575 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:27.573+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:27.576 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone23 from 0x4b50fb7 (overlap 0x8e8239) to 0x804200 2024-09-21T13:59:27.622 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.622 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:27.676 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:27.672+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:27.777 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:27.772+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:27.803 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.803 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.818 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:27.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:27.872+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:27.932 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-21T13:59:27.935 INFO:teuthology.orchestra.run.smithi079.stdout:3174 read 0x2ebb6fc thru 0x2ebc990 (0x1295 bytes) 2024-09-21T13:59:27.941 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:27.941 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:27.945 INFO:teuthology.orchestra.run.smithi079.stdout:3175 trunc from 0x4b50fb7 to 0x191d59e 2024-09-21T13:59:27.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:27.990 INFO:teuthology.orchestra.run.smithi079.stdout:3179 read 0xdc19d3 thru 0xdd1036 (0xf664 bytes) 2024-09-21T13:59:27.992 INFO:teuthology.orchestra.run.smithi079.stdout:3180 read 0x149818b thru 0x149e8e4 (0x675a bytes) 2024-09-21T13:59:27.992 INFO:teuthology.orchestra.run.smithi079.stdout:3181 punch from 0xfa980a to 0xfab1a9, (0x199f bytes) 2024-09-21T13:59:27.992 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.003 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:28.001+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:28.003 INFO:teuthology.orchestra.run.smithi079.stdout:3184 trunc from 0x191d59e to 0x5b89b38 2024-09-21T13:59:28.039 INFO:teuthology.orchestra.run.smithi079.stdout:3185 trunc from 0x5b89b38 to 0xe73d5a5 2024-09-21T13:59:28.061 INFO:teuthology.orchestra.run.smithi079.stdout:3186 write 0xe917884 thru 0xe924e88 (0xd605 bytes) 2024-09-21T13:59:28.068 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.080 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:28.076+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:28.084 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:28.084 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:28.089 INFO:teuthology.orchestra.run.smithi079.stdout:3190 trunc from 0xe924e89 to 0x6ec0d1c 2024-09-21T13:59:28.098 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:28.137 INFO:teuthology.orchestra.run.smithi079.stdout:3191 writesame 0xd1f3a57 thru 0xd1f9420 data_size 0x9(0x59ca bytes) 2024-09-21T13:59:28.137 INFO:teuthology.orchestra.run.smithi079.stdout:3192 writesame 0x525308f thru 0x525459d data_size 0x3(0x150f bytes) 2024-09-21T13:59:28.145 INFO:teuthology.orchestra.run.smithi079.stdout:3193 punch from 0x63f4e1a to 0x63f90ca, (0x42b0 bytes) 2024-09-21T13:59:28.166 INFO:teuthology.orchestra.run.smithi079.stdout:3194 trunc from 0xd1f9421 to 0x4bf3087 2024-09-21T13:59:28.180 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:28.176+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:28.186 INFO:teuthology.orchestra.run.smithi079.stdout:3196 writesame 0x2c60739 thru 0x2c6fccd data_size 0x1(0xf595 bytes) 2024-09-21T13:59:28.233 INFO:teuthology.orchestra.run.smithi079.stdout:3197 read 0x4bea10f thru 0x4bf3086 (0x8f78 bytes) 2024-09-21T13:59:28.252 INFO:teuthology.orchestra.run.smithi079.stdout:3199 write 0x80141bf thru 0x801a2bf (0x6101 bytes) 2024-09-21T13:59:28.258 INFO:teuthology.orchestra.run.smithi079.stdout:3200 read 0x196c8a5 thru 0x197b26e (0xe9ca bytes) 2024-09-21T13:59:28.258 INFO:teuthology.orchestra.run.smithi079.stdout:3201 read 0xe219ea thru 0xe25952 (0x3f69 bytes) 2024-09-21T13:59:28.260 INFO:teuthology.orchestra.run.smithi079.stdout:3202 trunc from 0x801a2c0 to 0x789a7a7 2024-09-21T13:59:28.273 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:28.274 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:28.275 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:28.275 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:28.275 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T13:59:28.275 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 1.000000 2024-09-21T13:59:28.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-21T13:59:28.281 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.281 INFO:teuthology.orchestra.run.smithi079.stdout:3204 write 0x2f1d038 thru 0x2f28ba1 (0xbb6a bytes) 2024-09-21T13:59:28.281 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:28.277+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:28.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:28.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:59:28.311 INFO:teuthology.orchestra.run.smithi079.stdout:3205 writesame 0xd7ae010 thru 0xd7bdbfc data_size 0x29(0xfbed bytes) 2024-09-21T13:59:28.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.311 INFO:teuthology.orchestra.run.smithi079.stdout:3207 write 0x791e96a thru 0x79212c2 (0x2959 bytes) 2024-09-21T13:59:28.317 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.317 INFO:teuthology.orchestra.run.smithi079.stdout:3211 writesame 0x540b37a thru 0x541413f data_size 0x45(0x8dc6 bytes) 2024-09-21T13:59:28.327 INFO:teuthology.orchestra.run.smithi079.stdout:3212 read 0x1156586 thru 0x11569a0 (0x41b bytes) 2024-09-21T13:59:28.327 INFO:teuthology.orchestra.run.smithi079.stdout:3213 punch from 0x54edc8f to 0x54f0a71, (0x2de2 bytes) 2024-09-21T13:59:28.327 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.328 INFO:teuthology.orchestra.run.smithi079.stdout:3215 punch from 0x2893606 to 0x2896365, (0x2d5f bytes) 2024-09-21T13:59:28.328 INFO:teuthology.orchestra.run.smithi079.stdout:3216 write 0x30d4b50 thru 0x30db19b (0x664c bytes) 2024-09-21T13:59:28.331 INFO:teuthology.orchestra.run.smithi079.stdout:3218 read 0xb5d4952 thru 0xb5dcef1 (0x85a0 bytes) 2024-09-21T13:59:28.350 INFO:teuthology.orchestra.run.smithi079.stdout:3220 trunc from 0xd7bdbfd to 0x1ae0b0c 2024-09-21T13:59:28.374 INFO:teuthology.orchestra.run.smithi079.stdout:3221 trunc from 0x1ae0b0c to 0x542dbc4 2024-09-21T13:59:28.382 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:28.376+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:28.397 INFO:teuthology.orchestra.run.smithi079.stdout:3222 write 0xaff61ba thru 0xafffd56 (0x9b9d bytes) 2024-09-21T13:59:28.402 INFO:teuthology.orchestra.run.smithi079.stdout:3223 read 0xf093e5 thru 0xf1169a (0x82b6 bytes) 2024-09-21T13:59:28.402 INFO:teuthology.orchestra.run.smithi079.stdout:3224 write 0x116e2c5 thru 0x117af87 (0xccc3 bytes) 2024-09-21T13:59:28.407 INFO:teuthology.orchestra.run.smithi079.stdout:3226 punch from 0x50364c9 to 0x503a6da, (0x4211 bytes) 2024-09-21T13:59:28.407 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.414 INFO:teuthology.orchestra.run.smithi079.stdout:3228 write 0xb08f8cb thru 0xb095e76 (0x65ac bytes) 2024-09-21T13:59:28.419 INFO:teuthology.orchestra.run.smithi079.stdout:3229 write 0x7b3cce thru 0x7ba1ba (0x64ed bytes) 2024-09-21T13:59:28.431 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.431 INFO:teuthology.orchestra.run.smithi079.stdout:3233 write 0x697741b thru 0x69840cb (0xccb1 bytes) 2024-09-21T13:59:28.437 INFO:teuthology.orchestra.run.smithi079.stdout:3235 read 0x7932853 thru 0x7942455 (0xfc03 bytes) 2024-09-21T13:59:28.437 INFO:teuthology.orchestra.run.smithi079.stdout:3237 write 0xa6bea72 thru 0xa6beccd (0x25c bytes) 2024-09-21T13:59:28.441 INFO:teuthology.orchestra.run.smithi079.stdout:3238 write 0x206cfd1 thru 0x2078fea (0xc01a bytes) 2024-09-21T13:59:28.454 INFO:teuthology.orchestra.run.smithi079.stdout:3239 trunc from 0xb095e77 to 0x67c9847 2024-09-21T13:59:28.463 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:28.463 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:28.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:28.479 INFO:teuthology.orchestra.run.smithi079.stdout:3240 trunc from 0x67c9847 to 0xca61465 2024-09-21T13:59:28.482 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:28.476+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:28.494 INFO:teuthology.orchestra.run.smithi079.stdout:3243 writesame 0xe945741 thru 0xe94e344 data_size 0x57(0x8c04 bytes) 2024-09-21T13:59:28.494 INFO:teuthology.orchestra.run.smithi079.stdout:3244 punch from 0x3ba3370 to 0x3ba68a9, (0x3539 bytes) 2024-09-21T13:59:28.498 INFO:teuthology.orchestra.run.smithi079.stdout:3247 trunc from 0xe94e345 to 0xbdb3f8b 2024-09-21T13:59:28.504 INFO:teuthology.orchestra.run.smithi079.stdout:3248 writesame 0x4b463fb thru 0x4b53b06 data_size 0x2(0xd70c bytes) 2024-09-21T13:59:28.526 INFO:teuthology.orchestra.run.smithi079.stdout:3249 read 0x2a3348b thru 0x2a3cb78 (0x96ee bytes) 2024-09-21T13:59:28.527 INFO:teuthology.orchestra.run.smithi079.stdout:3251 read 0xa8517d8 thru 0xa85ba20 (0xa249 bytes) 2024-09-21T13:59:28.527 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.527 INFO:teuthology.orchestra.run.smithi079.stdout:3254 punch from 0x116eb1f to 0x117d85a, (0xed3b bytes) 2024-09-21T13:59:28.527 INFO:teuthology.orchestra.run.smithi079.stdout:3257 punch from 0xac68b68 to 0xac768ff, (0xdd97 bytes) 2024-09-21T13:59:28.527 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.528 INFO:teuthology.orchestra.run.smithi079.stdout:3259 trunc from 0xbdb3f8b to 0xb0cf0d8 2024-09-21T13:59:28.537 INFO:teuthology.orchestra.run.smithi079.stdout:3261 punch from 0xa1483c to 0xa17c3d, (0x3401 bytes) 2024-09-21T13:59:28.537 INFO:teuthology.orchestra.run.smithi079.stdout:3262 read 0x58feb1c thru 0x590a7fd (0xbce2 bytes) 2024-09-21T13:59:28.537 INFO:teuthology.orchestra.run.smithi079.stdout:3263 trunc from 0xb0cf0d8 to 0xb7a0057 2024-09-21T13:59:28.545 INFO:teuthology.orchestra.run.smithi079.stdout:3265 write 0x8ad4ea1 thru 0x8ada961 (0x5ac1 bytes) 2024-09-21T13:59:28.551 INFO:teuthology.orchestra.run.smithi079.stdout:3267 punch from 0x827035a to 0x8274118, (0x3dbe bytes) 2024-09-21T13:59:28.551 INFO:teuthology.orchestra.run.smithi079.stdout:3273 read 0x6af5e68 thru 0x6b027f5 (0xc98e bytes) 2024-09-21T13:59:28.551 INFO:teuthology.orchestra.run.smithi079.stdout:3274 write 0xb25c358 thru 0xb2698b3 (0xd55c bytes) 2024-09-21T13:59:28.558 INFO:teuthology.orchestra.run.smithi079.stdout:3275 read 0x8894381 thru 0x889a7f1 (0x6471 bytes) 2024-09-21T13:59:28.558 INFO:teuthology.orchestra.run.smithi079.stdout:3276 write 0xb69d600 thru 0xb6a20fa (0x4afb bytes) 2024-09-21T13:59:28.565 INFO:teuthology.orchestra.run.smithi079.stdout:3277 read 0x6757fad thru 0x675fa6f (0x7ac3 bytes) 2024-09-21T13:59:28.565 INFO:teuthology.orchestra.run.smithi079.stdout:3278 write 0x167d03d thru 0x1682cb6 (0x5c7a bytes) 2024-09-21T13:59:28.576 INFO:teuthology.orchestra.run.smithi079.stdout:3279 trunc from 0xb7a0057 to 0xe3fb7eb 2024-09-21T13:59:28.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:28.584 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:28.581+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:28.593 INFO:teuthology.orchestra.run.smithi079.stdout:3280 trunc from 0xe3fb7eb to 0x997823a 2024-09-21T13:59:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:28.602 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:28.611 INFO:teuthology.orchestra.run.smithi079.stdout:3281 trunc from 0x997823a to 0xb35e4bc 2024-09-21T13:59:28.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:28.620 INFO:teuthology.orchestra.run.smithi079.stdout:3283 writesame 0x6ef5b47 thru 0x6f01ccc data_size 0x45(0xc186 bytes) 2024-09-21T13:59:28.627 INFO:teuthology.orchestra.run.smithi079.stdout:3284 write 0x5ad280f thru 0x5ad3a9d (0x128f bytes) 2024-09-21T13:59:28.632 INFO:teuthology.orchestra.run.smithi079.stdout:3287 punch from 0x3c66b53 to 0x3c6d0c9, (0x6576 bytes) 2024-09-21T13:59:28.632 INFO:teuthology.orchestra.run.smithi079.stdout:3288 writesame 0x239474f thru 0x239a29e data_size 0x18(0x5b50 bytes) 2024-09-21T13:59:28.636 INFO:teuthology.orchestra.run.smithi079.stdout:3289 punch from 0x69289fc to 0x6936b04, (0xe108 bytes) 2024-09-21T13:59:28.636 INFO:teuthology.orchestra.run.smithi079.stdout:3290 read 0x90b3dbf thru 0x90bb78f (0x79d1 bytes) 2024-09-21T13:59:28.637 INFO:teuthology.orchestra.run.smithi079.stdout:3291 read 0xa0fcb71 thru 0xa103d7f (0x720f bytes) 2024-09-21T13:59:28.637 INFO:teuthology.orchestra.run.smithi079.stdout:3292 write 0x1485b02 thru 0x149424d (0xe74c bytes) 2024-09-21T13:59:28.640 INFO:teuthology.orchestra.run.smithi079.stdout:3294 write 0x881aae8 thru 0x8824027 (0x9540 bytes) 2024-09-21T13:59:28.644 INFO:teuthology.orchestra.run.smithi079.stdout:3296 writesame 0x3a8a091 thru 0x3a90171 data_size 0x7(0x60e1 bytes) 2024-09-21T13:59:28.649 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.652 INFO:teuthology.orchestra.run.smithi079.stdout:3301 trunc from 0xb35e4bc to 0xcd73656 2024-09-21T13:59:28.659 INFO:teuthology.orchestra.run.smithi079.stdout:3302 write 0x63ae18f thru 0x63bb3b7 (0xd229 bytes) 2024-09-21T13:59:28.665 INFO:teuthology.orchestra.run.smithi079.stdout:3303 write 0x34088e0 thru 0x341858e (0xfcaf bytes) 2024-09-21T13:59:28.671 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.671 INFO:teuthology.orchestra.run.smithi079.stdout:3307 read 0x5882500 thru 0x589061f (0xe120 bytes) 2024-09-21T13:59:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:3308 punch from 0x10ee62b to 0x10f172c, (0x3101 bytes) 2024-09-21T13:59:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:3309 read 0x74db898 thru 0x74e5054 (0x97bd bytes) 2024-09-21T13:59:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:3310 read 0x561273c thru 0x5622594 (0xfe59 bytes) 2024-09-21T13:59:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:3313 read 0x8d1d635 thru 0x8d292ce (0xbc9a bytes) 2024-09-21T13:59:28.672 INFO:teuthology.orchestra.run.smithi079.stdout:3314 writesame 0x9dab803 thru 0x9db86cd data_size 0x1(0xcecb bytes) 2024-09-21T13:59:28.701 INFO:teuthology.orchestra.run.smithi079.stdout:3316 read 0x32fd32f thru 0x330cc1b (0xf8ed bytes) 2024-09-21T13:59:28.701 INFO:teuthology.orchestra.run.smithi079.stdout:3317 read 0x6618f66 thru 0x6625fdf (0xd07a bytes) 2024-09-21T13:59:28.706 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:28.705+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:28.717 INFO:teuthology.orchestra.run.smithi079.stdout:3318 trunc from 0xcd73656 to 0x23fa374 2024-09-21T13:59:28.727 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:28.727 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:28.745 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:28.746 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:28.758 INFO:teuthology.orchestra.run.smithi079.stdout:3320 write 0xed31189 thru 0xed3f2a9 (0xe121 bytes) 2024-09-21T13:59:28.762 INFO:teuthology.orchestra.run.smithi079.stdout:3322 write 0x18be34e thru 0x18c389b (0x554e bytes) 2024-09-21T13:59:28.764 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:28.764 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:28.765 INFO:teuthology.orchestra.run.smithi079.stdout:3323 read 0x8a4b76c thru 0x8a5359f (0x7e34 bytes) 2024-09-21T13:59:28.781 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:28.781 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:28.783 INFO:teuthology.orchestra.run.smithi079.stdout:3324 trunc from 0xed3f2aa to 0x20c7a09 2024-09-21T13:59:28.785 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:28.781+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:28.793 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:28.793 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:28.799 INFO:teuthology.orchestra.run.smithi079.stdout:3325 read 0x10b3757 thru 0x10b8785 (0x502f bytes) 2024-09-21T13:59:28.800 INFO:teuthology.orchestra.run.smithi079.stdout:3326 write 0x81e390 thru 0x82d977 (0xf5e8 bytes) 2024-09-21T13:59:28.802 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:28.802 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:28.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:28.824 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:3327 write 0x916a6ee thru 0x916b684 (0xf97 bytes) 2024-09-21T13:59:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.834 INFO:teuthology.orchestra.run.smithi079.stdout:3329 write 0x8dc3199 thru 0x8dd0810 (0xd678 bytes) 2024-09-21T13:59:28.839 INFO:teuthology.orchestra.run.smithi079.stdout:3331 punch from 0x6b58416 to 0x6b5d613, (0x51fd bytes) 2024-09-21T13:59:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:3335 punch from 0x8a0d19b to 0x8a17b46, (0xa9ab bytes) 2024-09-21T13:59:28.846 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:28.847 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:28.847 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:28.847 INFO:teuthology.orchestra.run.smithi079.stdout:3337 write 0x9f18e79 thru 0x9f1e0e0 (0x5268 bytes) 2024-09-21T13:59:28.850 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:28.850 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:28.851 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.851 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.855 INFO:teuthology.orchestra.run.smithi079.stdout:3340 trunc from 0x9f1e0e1 to 0x6d080f9 2024-09-21T13:59:28.869 INFO:teuthology.orchestra.run.smithi079.stdout:3341 read 0x1d9e2a7 thru 0x1da6ea6 (0x8c00 bytes) 2024-09-21T13:59:28.886 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:28.880+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:28.889 INFO:teuthology.orchestra.run.smithi079.stdout:3342 write 0xe6e77ee thru 0xe6e7b98 (0x3ab bytes) 2024-09-21T13:59:28.893 INFO:teuthology.orchestra.run.smithi079.stdout:3343 read 0x8c688e9 thru 0x8c75498 (0xcbb0 bytes) 2024-09-21T13:59:28.893 INFO:teuthology.orchestra.run.smithi079.stdout:3345 punch from 0x62157bb to 0x62249c1, (0xf206 bytes) 2024-09-21T13:59:28.893 INFO:teuthology.orchestra.run.smithi079.stdout:3346 read 0xcb5cc5e thru 0xcb69234 (0xc5d7 bytes) 2024-09-21T13:59:28.893 INFO:teuthology.orchestra.run.smithi079.stdout:3347 punch from 0x27b7a10 to 0x27c2273, (0xa863 bytes) 2024-09-21T13:59:28.894 INFO:teuthology.orchestra.run.smithi079.stdout:3349 writesame 0x11793f0 thru 0x1187523 data_size 0x8e(0xe134 bytes) 2024-09-21T13:59:28.898 INFO:teuthology.orchestra.run.smithi079.stdout:3350 punch from 0x362b40a to 0x362e292, (0x2e88 bytes) 2024-09-21T13:59:28.898 INFO:teuthology.orchestra.run.smithi079.stdout:3351 read 0x5f7e737 thru 0x5f7fb54 (0x141e bytes) 2024-09-21T13:59:28.898 INFO:teuthology.orchestra.run.smithi079.stdout:3352 read 0x3a7eb0d thru 0x3a84f1e (0x6412 bytes) 2024-09-21T13:59:28.898 INFO:teuthology.orchestra.run.smithi079.stdout:3354 writesame 0x7fa2c09 thru 0x7fa603a data_size 0x11(0x3432 bytes) 2024-09-21T13:59:28.903 INFO:teuthology.orchestra.run.smithi079.stdout:3355 read 0x89d03cf thru 0x89ddda9 (0xd9db bytes) 2024-09-21T13:59:28.903 INFO:teuthology.orchestra.run.smithi079.stdout:3356 write 0xdaa985b thru 0xdab3a7d (0xa223 bytes) 2024-09-21T13:59:28.909 INFO:teuthology.orchestra.run.smithi079.stdout:3357 punch from 0x1f084f3 to 0x1f104a0, (0x7fad bytes) 2024-09-21T13:59:28.909 INFO:teuthology.orchestra.run.smithi079.stdout:3359 write 0xb3871b6 thru 0xb38e355 (0x71a0 bytes) 2024-09-21T13:59:28.914 INFO:teuthology.orchestra.run.smithi079.stdout:3361 punch from 0xcb144eb to 0xcb18cdf, (0x47f4 bytes) 2024-09-21T13:59:28.914 INFO:teuthology.orchestra.run.smithi079.stdout:3362 read 0xc37d35c thru 0xc38354a (0x61ef bytes) 2024-09-21T13:59:28.914 INFO:teuthology.orchestra.run.smithi079.stdout:3363 writesame 0xbd7bd8c thru 0xbd7bed0 data_size 0x5(0x145 bytes) 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:3364 read 0x483db61 thru 0x484a1cb (0xc66b bytes) 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:3365 read 0x8f47c08 thru 0x8f4b3d6 (0x37cf bytes) 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:3368 punch from 0xb26e67c to 0xb275a77, (0x73fb bytes) 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.918 INFO:teuthology.orchestra.run.smithi079.stdout:3371 punch from 0xbf98881 to 0xbf9d79d, (0x4f1c bytes) 2024-09-21T13:59:28.920 INFO:teuthology.orchestra.run.smithi079.stdout:3372 trunc from 0xe6e7b99 to 0xd7b1e5e 2024-09-21T13:59:28.937 INFO:teuthology.orchestra.run.smithi079.stdout:3373 write 0xa385aa8 thru 0xa38aec8 (0x5421 bytes) 2024-09-21T13:59:28.943 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.952 INFO:teuthology.orchestra.run.smithi079.stdout:3377 write 0xde89a45 thru 0xde97287 (0xd843 bytes) 2024-09-21T13:59:28.958 INFO:teuthology.orchestra.run.smithi079.stdout:3378 writesame 0x4ef2ce9 thru 0x4efae54 data_size 0x42(0x816c bytes) 2024-09-21T13:59:28.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:28.964 INFO:teuthology.orchestra.run.smithi079.stdout:3381 write 0xddffadb thru 0xde09c1f (0xa145 bytes) 2024-09-21T13:59:28.969 INFO:teuthology.orchestra.run.smithi079.stdout:3382 write 0xbdb9293 thru 0xbdc429b (0xb009 bytes) 2024-09-21T13:59:28.973 INFO:teuthology.orchestra.run.smithi079.stdout:3384 read 0xb784fbc thru 0xb78eea0 (0x9ee5 bytes) 2024-09-21T13:59:28.974 INFO:teuthology.orchestra.run.smithi079.stdout:3385 read 0x326ad7d thru 0x32712f0 (0x6574 bytes) 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.102855877000003, 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:28.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:28.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:28.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:28.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.094978714, 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.091041691999997, 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.091030482999997, 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.091019310999997, 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.091005008000003, 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.090969547999997, 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.090956384999998, 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.090944854, 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086956886000003, 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086937253999999, 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086912425999998, 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086887429000001, 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086875358999997, 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086864038999998, 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086852897999997, 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086840596999998, 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.086829344999998, 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.010759593000003, 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.001533017, 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:29.073 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:29.074 INFO:teuthology.orchestra.run.smithi079.stdout:3388 trunc from 0xde97288 to 0x6a76cba 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:3389 write 0x6b9b383 thru 0x6b9f9f5 (0x4673 bytes) 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:3393 punch from 0x549c45c to 0x54a708c, (0xac30 bytes) 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:3394 read 0x21d88d7 thru 0x21dad12 (0x243c bytes) 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:3396 writesame 0x90c5902 thru 0x90d3411 data_size 0x14(0xdb10 bytes) 2024-09-21T13:59:29.075 INFO:teuthology.orchestra.run.smithi079.stdout:3399 write 0xdaeb4c6 thru 0xdaf2454 (0x6f8f bytes) 2024-09-21T13:59:29.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:29.068+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:29.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:29.081 INFO:teuthology.orchestra.run.smithi079.stdout:3400 punch from 0x8be82e5 to 0x8bef585, (0x72a0 bytes) 2024-09-21T13:59:29.093 INFO:teuthology.orchestra.run.smithi079.stdout:3401 write 0xdf14eb0 thru 0xdf17c4c (0x2d9d bytes) 2024-09-21T13:59:29.097 INFO:teuthology.orchestra.run.smithi079.stdout:3404 read 0xd20b281 thru 0xd20cfbb (0x1d3b bytes) 2024-09-21T13:59:29.097 INFO:teuthology.orchestra.run.smithi079.stdout:3405 read 0xaf83386 thru 0xaf8ac41 (0x78bc bytes) 2024-09-21T13:59:29.098 INFO:teuthology.orchestra.run.smithi079.stdout:3406 write 0x73bdee4 thru 0x73c09f3 (0x2b10 bytes) 2024-09-21T13:59:29.105 INFO:teuthology.orchestra.run.smithi079.stdout:3407 writesame 0x941ab8d thru 0x9429827 data_size 0x11(0xec9b bytes) 2024-09-21T13:59:29.113 INFO:teuthology.orchestra.run.smithi079.stdout:3408 read 0xc76d697 thru 0xc773fbc (0x6926 bytes) 2024-09-21T13:59:29.113 INFO:teuthology.orchestra.run.smithi079.stdout:3409 clone 25 order 23 su 2097152 sc 3 2024-09-21T13:59:29.175 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:29.172+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:29.207 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:29.207 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:29.207 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:29.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:29.276 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:29.273+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:29.300 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-21T13:59:29.300 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:59:29.377 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:29.373+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:29.407 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:29.407 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:29.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:29.478 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:29.473+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:29.548 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.941765199999999, 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:29.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:29.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126316 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 227328~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010330199000002, 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050221382000000002, 2024-09-21T13:59:29.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126316 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537488+0000", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537487+0000", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537492+0000", 2024-09-21T13:59:29.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1080000000000003e-06 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537495+0000", 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1480000000000002e-06 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537497+0000", 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3250000000000002e-06 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587474+0000", 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049977374999999997 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587563+0000", 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8508e-05 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587709+0000", 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000146129 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126317 3.12 3:48a1082a:::rbd_data.11852774f807.0000000000000011:d [read 247808~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010318550999997, 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050473885000000003, 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126317 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537499+0000", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537504+0000", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7729999999999999e-06 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537509+0000", 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5319999999999997e-06 2024-09-21T13:59:29.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537512+0000", 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4729999999999999e-06 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587758+0000", 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050246489999999998 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587848+0000", 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9950000000000004e-05 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587973+0000", 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012499700000000001 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126369 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 4096~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010302029999998, 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050784915, 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126369 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537516+0000", 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537515+0000", 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537517+0000", 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.984e-06 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537524+0000", 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2040000000000002e-06 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537533+0000", 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9360000000000005e-06 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.587999+0000", 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050466364999999999 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588044+0000", 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5015999999999997e-05 2024-09-21T13:59:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588301+0000", 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025690000000000001 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126370 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 30720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010281218000003, 2024-09-21T13:59:29.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050926705000000003, 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126370 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537536+0000", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537538+0000", 2024-09-21T13:59:29.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537544+0000", 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4689999999999996e-06 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537548+0000", 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588328+0000", 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050779457 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588384+0000", 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6156999999999998e-05 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588463+0000", 2024-09-21T13:59:29.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9390999999999999e-05 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126371 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010265697999998, 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051068768, 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126371 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537554+0000", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9719999999999999e-06 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537559+0000", 2024-09-21T13:59:29.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537564+0000", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4399999999999998e-06 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588488+0000", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050924687000000003 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588551+0000", 2024-09-21T13:59:29.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2268999999999996e-05 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588621+0000", 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0227000000000004e-05 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126372 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010250483999997, 2024-09-21T13:59:29.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051259907, 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126372 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537569+0000", 2024-09-21T13:59:29.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9910000000000001e-06 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537575+0000", 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7570000000000001e-06 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537579+0000", 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3649999999999997e-06 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588646+0000", 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051067250000000002 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588712+0000", 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5172000000000006e-05 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588827+0000", 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011572 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126373 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010234584999999, 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051569028000000003, 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126373 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537585+0000", 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.852e-06 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537591+0000", 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.728e-06 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537595+0000", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588853+0000", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051257748999999998 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588909+0000", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6140000000000001e-05 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589152+0000", 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000243432 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010219460000002, 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:29.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.590 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010204092000002, 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:29.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:29.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010188941999999, 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:29.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:29.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.010153428999999, 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.600 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:29.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:29.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141000 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 431104~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:29.604 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664540352, 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050082146000000001, 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141000 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883278+0000", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883277+0000", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883280+0000", 2024-09-21T13:59:29.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.34e-06 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883287+0000", 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.559e-06 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883292+0000", 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8690000000000003e-06 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933051+0000", 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049758720999999999 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933129+0000", 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8677999999999994e-05 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933360+0000", 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000230354 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141001 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664521729000001, 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050465547999999999, 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141001 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883296+0000", 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883298+0000", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883306+0000", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4150000000000002e-06 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883310+0000", 2024-09-21T13:59:29.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933440+0000", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050129114000000002 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933522+0000", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2812000000000006e-05 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933762+0000", 2024-09-21T13:59:29.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023933900000000001 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141002 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 441344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664503174, 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050811505999999999, 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141002 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883315+0000", 2024-09-21T13:59:29.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883314+0000", 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883317+0000", 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.323e-06 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883323+0000", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2389999999999999e-06 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883330+0000", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1080000000000004e-06 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933791+0000", 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050460855999999998 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.933869+0000", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8596000000000004e-05 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934126+0000", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025674500000000001 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141003 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:29.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664483421, 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051137289000000002, 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141003 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883336+0000", 2024-09-21T13:59:29.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883344+0000", 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-06 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883349+0000", 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8250000000000004e-06 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934156+0000", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050807057000000003 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934234+0000", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7729000000000001e-05 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934472+0000", 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023826899999999999 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141004 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 451584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664464991999999, 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.05147119, 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141004 2024-09-21T13:59:29.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883355+0000", 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2340000000000001e-06 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883362+0000", 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4189999999999996e-06 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883367+0000", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934501+0000", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051133396999999997 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934579+0000", 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7818999999999995e-05 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934824+0000", 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024550599999999999 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.664446424000001, 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:29.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:29.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:29.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:29.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.994423784, 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T13:59:29.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.993096074, 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:29.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:29.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:29.642 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:29.643 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone24 from 0xdf17c4d (overlap 0x191d59e) to 0x788ce2 2024-09-21T13:59:29.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:29.645 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:29.641+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:29.744 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:29.741+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:29.780 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:29.780 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:29.781 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:29.781 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:29.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:29.847 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:29.844+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:29.918 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:29.918 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:29.919 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:29.919 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:29.919 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:29.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:29.946 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:29.941+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:30.046 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:30.040+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:30.115 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.277270354000002, 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:30.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:30.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.137246914000002, 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:30.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:30.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:30.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.108987909, 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.211879363999998, 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:30.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.135 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.211817895000003, 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:30.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.203647144999998, 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202753919999999, 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202696160000002, 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.152 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202677567999999, 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.153 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:30.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:30.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202665230000001, 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.161 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202643494, 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202620310999997, 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.166 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202599882000001, 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.174 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202585083999999, 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:30.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202560499999997, 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202543804000001, 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.186 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.202521566999998, 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:30.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:30.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.284233264000001, 2024-09-21T13:59:30.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:30.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:30.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.114714716000002, 2024-09-21T13:59:30.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:30.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.751476122, 2024-09-21T13:59:30.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:30.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:30.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:30.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.209 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:30.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:3410 punch from 0xd28b54b to 0xd28cae6, (0x159b bytes) 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:3413 write 0x4ff549b thru 0x5000713 (0xb279 bytes) 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:3415 write 0xa91b0bd thru 0xa927a4f (0xc993 bytes) 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:3416 write 0x3ca96eb thru 0x3cb93b8 (0xfcce bytes) 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.212 INFO:teuthology.orchestra.run.smithi079.stdout:3419 write 0x1e81a7c thru 0x1e81dcf (0x354 bytes) 2024-09-21T13:59:30.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:30.208+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:30.237 INFO:teuthology.orchestra.run.smithi079.stdout:3421 trunc from 0xdf17c4d to 0x5c6efdd 2024-09-21T13:59:30.284 INFO:teuthology.orchestra.run.smithi079.stdout:3423 writesame 0x6f94a7e thru 0x6f9e38f data_size 0x3f(0x9912 bytes) 2024-09-21T13:59:30.303 INFO:teuthology.orchestra.run.smithi079.stdout:3425 write 0x9c82d9a thru 0x9c9186e (0xead5 bytes) 2024-09-21T13:59:30.309 INFO:teuthology.orchestra.run.smithi079.stdout:3428 read 0x982c8ed thru 0x982e207 (0x191b bytes) 2024-09-21T13:59:30.312 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:30.309+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:30.324 INFO:teuthology.orchestra.run.smithi079.stdout:3430 trunc from 0x9c9186f to 0x383e2f6 2024-09-21T13:59:30.354 INFO:teuthology.orchestra.run.smithi079.stdout:3432 read 0x2bbb3ec thru 0x2bc3689 (0x829e bytes) 2024-09-21T13:59:30.355 INFO:teuthology.orchestra.run.smithi079.stdout:3433 read 0xf5ec0d thru 0xf642a7 (0x569b bytes) 2024-09-21T13:59:30.356 INFO:teuthology.orchestra.run.smithi079.stdout:3434 read 0x23fed0 thru 0x24f532 (0xf663 bytes) 2024-09-21T13:59:30.357 INFO:teuthology.orchestra.run.smithi079.stdout:3436 read 0x1ea81af thru 0x1eaa099 (0x1eeb bytes) 2024-09-21T13:59:30.358 INFO:teuthology.orchestra.run.smithi079.stdout:3438 punch from 0x2ef9dc6 to 0x2efda76, (0x3cb0 bytes) 2024-09-21T13:59:30.358 INFO:teuthology.orchestra.run.smithi079.stdout:3439 read 0x7e68b0 thru 0x7eee86 (0x85d7 bytes) 2024-09-21T13:59:30.361 INFO:teuthology.orchestra.run.smithi079.stdout:3440 read 0x2f20dd8 thru 0x2f2f589 (0xe7b2 bytes) 2024-09-21T13:59:30.361 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.361 INFO:teuthology.orchestra.run.smithi079.stdout:3442 read 0x2f5e11c thru 0x2f665ca (0x84af bytes) 2024-09-21T13:59:30.361 INFO:teuthology.orchestra.run.smithi079.stdout:3443 read 0x76539c thru 0x76dc61 (0x88c6 bytes) 2024-09-21T13:59:30.365 INFO:teuthology.orchestra.run.smithi079.stdout:3446 trunc from 0x383e2f6 to 0x4761765 2024-09-21T13:59:30.376 INFO:teuthology.orchestra.run.smithi079.stdout:3447 read 0xb651b0 thru 0xb7507d (0xfece bytes) 2024-09-21T13:59:30.377 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:30.377 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:30.378 INFO:teuthology.orchestra.run.smithi079.stdout:3448 punch from 0x3f8d1af to 0x3f9398e, (0x67df bytes) 2024-09-21T13:59:30.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:3449 writesame 0xe25a9d3 thru 0xe268c27 data_size 0x1(0xe255 bytes) 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:3450 read 0xe217b1e thru 0xe21fc7d (0x8160 bytes) 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:3451 read 0xba2eee8 thru 0xba3de09 (0xef22 bytes) 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:3455 punch from 0x39f06f1 to 0x39f9e4d, (0x975c bytes) 2024-09-21T13:59:30.411 INFO:teuthology.orchestra.run.smithi079.stdout:3457 writesame 0xd7b370e thru 0xd7b39a1 data_size 0x2(0x294 bytes) 2024-09-21T13:59:30.413 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:30.409+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:30.417 INFO:teuthology.orchestra.run.smithi079.stdout:3458 write 0xbe75866 thru 0xbe7a2b2 (0x4a4d bytes) 2024-09-21T13:59:30.423 INFO:teuthology.orchestra.run.smithi079.stdout:3459 punch from 0x80eb6f4 to 0x80f629b, (0xaba7 bytes) 2024-09-21T13:59:30.423 INFO:teuthology.orchestra.run.smithi079.stdout:3461 write 0x45ddbe2 thru 0x45e1f7b (0x439a bytes) 2024-09-21T13:59:30.426 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.426 INFO:teuthology.orchestra.run.smithi079.stdout:3464 writesame 0xdd66e1a thru 0xdd68db9 data_size 0x17(0x1fa0 bytes) 2024-09-21T13:59:30.433 INFO:teuthology.orchestra.run.smithi079.stdout:3465 write 0x88e359d thru 0x88e35d3 (0x37 bytes) 2024-09-21T13:59:30.439 INFO:teuthology.orchestra.run.smithi079.stdout:3466 write 0x17010c8 thru 0x170bf6a (0xaea3 bytes) 2024-09-21T13:59:30.475 INFO:teuthology.orchestra.run.smithi079.stdout:3469 write 0x69bd875 thru 0x69cae39 (0xd5c5 bytes) 2024-09-21T13:59:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:3472 read 0x5e9e4b7 thru 0x5ea5547 (0x7091 bytes) 2024-09-21T13:59:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:3473 punch from 0xc7ff429 to 0xc803886, (0x445d bytes) 2024-09-21T13:59:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:3475 write 0x525149f thru 0x5251e22 (0x984 bytes) 2024-09-21T13:59:30.486 INFO:teuthology.orchestra.run.smithi079.stdout:3476 write 0x8d63c9 thru 0x8d98d4 (0x350c bytes) 2024-09-21T13:59:30.514 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:30.509+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:30.539 INFO:teuthology.orchestra.run.smithi079.stdout:3477 write 0x22b5128 thru 0x22b8065 (0x2f3e bytes) 2024-09-21T13:59:30.545 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:30.545 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:30.546 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:30.546 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:30.546 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:30.550 INFO:teuthology.orchestra.run.smithi079.stdout:3479 trunc from 0xe268c28 to 0xc8177da 2024-09-21T13:59:30.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:30.570 INFO:teuthology.orchestra.run.smithi079.stdout:3480 read 0x3b0cc87 thru 0x3b13877 (0x6bf1 bytes) 2024-09-21T13:59:30.571 INFO:teuthology.orchestra.run.smithi079.stdout:3481 write 0x15b5c87 thru 0x15c3299 (0xd613 bytes) 2024-09-21T13:59:30.572 INFO:teuthology.orchestra.run.smithi079.stdout:3483 writesame 0x55a2d03 thru 0x55b05ae data_size 0x62(0xd8ac bytes) 2024-09-21T13:59:30.579 INFO:teuthology.orchestra.run.smithi079.stdout:3484 read 0x8ac7f1 thru 0x8b33fe (0x6c0e bytes) 2024-09-21T13:59:30.580 INFO:teuthology.orchestra.run.smithi079.stdout:3485 punch from 0x22ad1e1 to 0x22b41f6, (0x7015 bytes) 2024-09-21T13:59:30.580 INFO:teuthology.orchestra.run.smithi079.stdout:3487 writesame 0x1079037 thru 0x10883cc data_size 0x13(0xf396 bytes) 2024-09-21T13:59:30.587 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.587 INFO:teuthology.orchestra.run.smithi079.stdout:3489 write 0x50c904 thru 0x51592e (0x902b bytes) 2024-09-21T13:59:30.591 INFO:teuthology.orchestra.run.smithi079.stdout:3490 write 0xacd38b4 thru 0xacddc49 (0xa396 bytes) 2024-09-21T13:59:30.593 INFO:teuthology.orchestra.run.smithi079.stdout:3491 writesame 0xaf9316e thru 0xaf9439a data_size 0x9(0x122d bytes) 2024-09-21T13:59:30.599 INFO:teuthology.orchestra.run.smithi079.stdout:3492 read 0x93fc20f thru 0x94017f1 (0x55e3 bytes) 2024-09-21T13:59:30.608 INFO:teuthology.orchestra.run.smithi079.stdout:3495 trunc from 0xc8177da to 0x6ce380f 2024-09-21T13:59:30.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:30.608+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:30.630 INFO:teuthology.orchestra.run.smithi079.stdout:3496 read 0x460d646 thru 0x4611ac1 (0x447c bytes) 2024-09-21T13:59:30.631 INFO:teuthology.orchestra.run.smithi079.stdout:3500 read 0x1310e7c thru 0x1319b68 (0x8ced bytes) 2024-09-21T13:59:30.631 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.631 INFO:teuthology.orchestra.run.smithi079.stdout:3502 read 0x954a3c thru 0x95f83b (0xae00 bytes) 2024-09-21T13:59:30.632 INFO:teuthology.orchestra.run.smithi079.stdout:3504 read 0x3150307 thru 0x315068e (0x388 bytes) 2024-09-21T13:59:30.647 INFO:teuthology.orchestra.run.smithi079.stdout:3505 write 0x98444f2 thru 0x98543cd (0xfedc bytes) 2024-09-21T13:59:30.654 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.673 INFO:teuthology.orchestra.run.smithi079.stdout:3509 write 0xe37f807 thru 0xe3898cb (0xa0c5 bytes) 2024-09-21T13:59:30.681 INFO:teuthology.orchestra.run.smithi079.stdout:3510 writesame 0xae2db29 thru 0xae381b6 data_size 0x1(0xa68e bytes) 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175784602, 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:30.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:30.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175672978999998, 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175653156000003, 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:30.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:30.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:30.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175628977000002, 2024-09-21T13:59:30.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:30.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175604872000001, 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:30.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:30.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175586363000001, 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:30.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:30.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175576620999998, 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175551761999998, 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.730 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:30.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:30.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175523085000002, 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:30.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175504267000001, 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.739 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:30.743 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175483595999999, 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175462525, 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.748 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:30.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:30.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:30.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175426672999997, 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:30.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:30.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175394451000003, 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:30.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:30.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:30.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:30.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175358811000002, 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175324332999999, 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.766 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:30.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175269772999997, 2024-09-21T13:59:30.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:30.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175230608, 2024-09-21T13:59:30.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:30.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:30.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:30.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175191871999999, 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:30.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:30.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.175167119000001, 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:30.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.789 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:30.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:30.792 INFO:teuthology.orchestra.run.smithi079.stdout:3511 writesame 0x56f1ff5 thru 0x570012c data_size 0x4(0xe138 bytes) 2024-09-21T13:59:30.792 INFO:teuthology.orchestra.run.smithi079.stdout:3512 writesame 0xcb1d91b thru 0xcb24f8d data_size 0x1(0x7673 bytes) 2024-09-21T13:59:30.792 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.792 INFO:teuthology.orchestra.run.smithi079.stdout:3514 write 0x5d5f276 thru 0x5d6d6d7 (0xe462 bytes) 2024-09-21T13:59:30.792 INFO:teuthology.orchestra.run.smithi079.stdout:3515 punch from 0x7895e46 to 0x789b70e, (0x58c8 bytes) 2024-09-21T13:59:30.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:30.788+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:30.798 INFO:teuthology.orchestra.run.smithi079.stdout:3516 trunc from 0xe3898cc to 0x9a1d0c2 2024-09-21T13:59:30.821 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.834 INFO:teuthology.orchestra.run.smithi079.stdout:3519 trunc from 0x9a1d0c2 to 0xe608324 2024-09-21T13:59:30.844 INFO:teuthology.orchestra.run.smithi079.stdout:3520 read 0x77a7b57 thru 0x77ae1db (0x6685 bytes) 2024-09-21T13:59:30.844 INFO:teuthology.orchestra.run.smithi079.stdout:3522 write 0x75067bb thru 0x750ee94 (0x86da bytes) 2024-09-21T13:59:30.847 INFO:teuthology.orchestra.run.smithi079.stdout:3523 write 0x122c77e thru 0x1232b47 (0x63ca bytes) 2024-09-21T13:59:30.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:30.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:30.896+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:30.896 INFO:teuthology.orchestra.run.smithi079.stdout:3524 write 0x5e32a89 thru 0x5e394d2 (0x6a4a bytes) 2024-09-21T13:59:30.900 INFO:teuthology.orchestra.run.smithi079.stdout:3526 writesame 0xab6840 thru 0xac58a1 data_size 0x1d(0xf062 bytes) 2024-09-21T13:59:30.905 INFO:teuthology.orchestra.run.smithi079.stdout:3527 punch from 0xed8673 to 0xee2f05, (0xa892 bytes) 2024-09-21T13:59:30.906 INFO:teuthology.orchestra.run.smithi079.stdout:3529 writesame 0x1720752 thru 0x172a95b data_size 0x7(0xa20a bytes) 2024-09-21T13:59:30.915 INFO:teuthology.orchestra.run.smithi079.stdout:3530 writesame 0x2ccc92c thru 0x2cd7bef data_size 0x22(0xb2c4 bytes) 2024-09-21T13:59:30.926 INFO:teuthology.orchestra.run.smithi079.stdout:3531 write 0x8e6baa2 thru 0x8e71959 (0x5eb8 bytes) 2024-09-21T13:59:30.933 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.933 INFO:teuthology.orchestra.run.smithi079.stdout:3534 read 0xe5b3dea thru 0xe5bcbbd (0x8dd4 bytes) 2024-09-21T13:59:30.933 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:30.933 INFO:teuthology.orchestra.run.smithi079.stdout:3536 writesame 0x3fb1b4 thru 0x409a6d data_size 0x1(0xe8ba bytes) 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:182939 3.b 3:d5091bd8:::rbd_data.1185b49580a.0000000000000001:head [stat out=16b,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:30.935208+0000", 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.001790477, 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018403619999999999, 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 182939 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935208+0000", 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935208+0000", 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935206+0000", 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935216+0000", 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9490000000000008e-06 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935234+0000", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7957000000000001e-05 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935243+0000", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5889999999999992e-06 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935299+0000", 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5322999999999999e-05 2024-09-21T13:59:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:30.935406+0000", 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106809 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-21T13:59:30.940 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:30.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:30.985 INFO:teuthology.orchestra.run.smithi079.stdout:3539 write 0x464c0ed thru 0x4654cde (0x8bf2 bytes) 2024-09-21T13:59:30.987 INFO:teuthology.orchestra.run.smithi079.stdout:3541 write 0x5c9aacb thru 0x5ca37fb (0x8d31 bytes) 2024-09-21T13:59:30.990 INFO:teuthology.orchestra.run.smithi079.stdout:3542 writesame 0x5e095a8 thru 0x5e09b73 data_size 0xe(0x5cc bytes) 2024-09-21T13:59:30.992 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:30.992+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:30.993 INFO:teuthology.orchestra.run.smithi079.stdout:3543 write 0x63007b4 thru 0x630a7e5 (0xa032 bytes) 2024-09-21T13:59:30.994 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:30.994 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:30.996 INFO:teuthology.orchestra.run.smithi079.stdout:3545 read 0x68788d4 thru 0x6886bd4 (0xe301 bytes) 2024-09-21T13:59:30.997 INFO:teuthology.orchestra.run.smithi079.stdout:3546 writesame 0x7555e02 thru 0x7557feb data_size 0x3(0x21ea bytes) 2024-09-21T13:59:31.002 INFO:teuthology.orchestra.run.smithi079.stdout:3548 write 0xa9cdd76 thru 0xa9da563 (0xc7ee bytes) 2024-09-21T13:59:31.008 INFO:teuthology.orchestra.run.smithi079.stdout:3549 read 0x4b57705 thru 0x4b5dd20 (0x661c bytes) 2024-09-21T13:59:31.008 INFO:teuthology.orchestra.run.smithi079.stdout:3550 read 0x1137569 thru 0x1141eae (0xa946 bytes) 2024-09-21T13:59:31.009 INFO:teuthology.orchestra.run.smithi079.stdout:3551 write 0x2763ccb thru 0x2771c6e (0xdfa4 bytes) 2024-09-21T13:59:31.011 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:31.012 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:31.012 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.012 INFO:teuthology.orchestra.run.smithi079.stdout:3553 read 0x3dbbeec thru 0x3dbfc0e (0x3d23 bytes) 2024-09-21T13:59:31.012 INFO:teuthology.orchestra.run.smithi079.stdout:3554 writesame 0x5d0282 thru 0x5d3c56 data_size 0x3f(0x39d5 bytes) 2024-09-21T13:59:31.016 INFO:teuthology.orchestra.run.smithi079.stdout:3555 writesame 0x3c05ec1 thru 0x3c10e7b data_size 0x1(0xafbb bytes) 2024-09-21T13:59:31.029 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:31.029 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:31.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.051 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:31.051 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:31.061 INFO:teuthology.orchestra.run.smithi079.stdout:3559 trunc from 0xe608324 to 0x267834 2024-09-21T13:59:31.074 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:31.074 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:31.094 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:31.089+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:31.098 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:31.098 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:31.115 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.115 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.115 INFO:teuthology.orchestra.run.smithi079.stdout:3560 trunc from 0x267834 to 0xc3214dc 2024-09-21T13:59:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:3562 read 0x4547ad7 thru 0x454f051 (0x757b bytes) 2024-09-21T13:59:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:3563 read 0xb518e0a thru 0xb526af3 (0xdcea bytes) 2024-09-21T13:59:31.123 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.128 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:31.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:31.134 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:31.134 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:31.135 INFO:teuthology.orchestra.run.smithi079.stdout:3565 writesame 0xd30b0de thru 0xd30f2f9 data_size 0x2(0x421c bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3566 read 0x447a773 thru 0x447cad3 (0x2361 bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3572 punch from 0x9423c46 to 0x9426d24, (0x30de bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3573 read 0x7db4b9d thru 0x7dba1d1 (0x5635 bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3574 punch from 0x397c289 to 0x397def4, (0x1c6b bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3575 punch from 0x63848ca to 0x638fe48, (0xb57e bytes) 2024-09-21T13:59:31.136 INFO:teuthology.orchestra.run.smithi079.stdout:3576 write 0x1663b8c thru 0x166bf60 (0x83d5 bytes) 2024-09-21T13:59:31.138 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.139 INFO:teuthology.orchestra.run.smithi079.stdout:3580 writesame 0x9edc7d6 thru 0x9ee791a data_size 0x7(0xb145 bytes) 2024-09-21T13:59:31.151 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.161 INFO:teuthology.orchestra.run.smithi079.stdout:3583 write 0xe789e89 thru 0xe790cff (0x6e77 bytes) 2024-09-21T13:59:31.167 INFO:teuthology.orchestra.run.smithi079.stdout:3586 read 0xb88774 thru 0xb8df99 (0x5826 bytes) 2024-09-21T13:59:31.167 INFO:teuthology.orchestra.run.smithi079.stdout:3587 read 0x2079fab thru 0x20825b3 (0x8609 bytes) 2024-09-21T13:59:31.168 INFO:teuthology.orchestra.run.smithi079.stdout:3588 write 0xd11a918 thru 0xd11d1ed (0x28d6 bytes) 2024-09-21T13:59:31.173 INFO:teuthology.orchestra.run.smithi079.stdout:3589 write 0x6687e68 thru 0x668e7bb (0x6954 bytes) 2024-09-21T13:59:31.179 INFO:teuthology.orchestra.run.smithi079.stdout:3591 write 0x8d11c41 thru 0x8d182f9 (0x66b9 bytes) 2024-09-21T13:59:31.184 INFO:teuthology.orchestra.run.smithi079.stdout:3592 read 0xc972247 thru 0xc981232 (0xefec bytes) 2024-09-21T13:59:31.184 INFO:teuthology.orchestra.run.smithi079.stdout:3593 write 0xc131725 thru 0xc135c68 (0x4544 bytes) 2024-09-21T13:59:31.188 INFO:teuthology.orchestra.run.smithi079.stdout:3594 punch from 0x254c1d2 to 0x2553d0a, (0x7b38 bytes) 2024-09-21T13:59:31.189 INFO:teuthology.orchestra.run.smithi079.stdout:3595 read 0x40957d4 thru 0x409a861 (0x508e bytes) 2024-09-21T13:59:31.189 INFO:teuthology.orchestra.run.smithi079.stdout:3596 writesame 0xc49ded2 thru 0xc49fbd1 data_size 0x10(0x1d00 bytes) 2024-09-21T13:59:31.195 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:31.196+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:31.196 INFO:teuthology.orchestra.run.smithi079.stdout:3597 trunc from 0xe790d00 to 0xad2e0bd 2024-09-21T13:59:31.214 INFO:teuthology.orchestra.run.smithi079.stdout:3598 trunc from 0xad2e0bd to 0xa9212d8 2024-09-21T13:59:31.230 INFO:teuthology.orchestra.run.smithi079.stdout:3599 trunc from 0xa9212d8 to 0x62dd764 2024-09-21T13:59:31.269 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.269 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.276 INFO:teuthology.orchestra.run.smithi079.stdout:3600 write 0xc23f096 thru 0xc24971a (0xa685 bytes) 2024-09-21T13:59:31.284 INFO:teuthology.orchestra.run.smithi079.stdout:3601 writesame 0xf49ee5 thru 0xf5223b data_size 0x1(0x8357 bytes) 2024-09-21T13:59:31.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:31.303 INFO:teuthology.orchestra.run.smithi079.stdout:3602 write 0xda5d43 thru 0xdb3910 (0xdbce bytes) 2024-09-21T13:59:31.303 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:31.304+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:31.305 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:31.306 INFO:teuthology.orchestra.run.smithi079.stdout:3605 writesame 0x2c36ecc thru 0x2c46c71 data_size 0x1(0xfda6 bytes) 2024-09-21T13:59:31.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:59:31.340 INFO:teuthology.orchestra.run.smithi079.stdout:3606 punch from 0x5f94cbc to 0x5f956a5, (0x9e9 bytes) 2024-09-21T13:59:31.340 INFO:teuthology.orchestra.run.smithi079.stdout:3607 write 0x3532615 thru 0x35366ee (0x40da bytes) 2024-09-21T13:59:31.344 INFO:teuthology.orchestra.run.smithi079.stdout:3608 write 0x5a0d6f3 thru 0x5a1d21f (0xfb2d bytes) 2024-09-21T13:59:31.349 INFO:teuthology.orchestra.run.smithi079.stdout:3609 punch from 0x62c6596 to 0x62d520a, (0xec74 bytes) 2024-09-21T13:59:31.350 INFO:teuthology.orchestra.run.smithi079.stdout:3610 punch from 0x2ab4fd to 0x2ba37c, (0xee7f bytes) 2024-09-21T13:59:31.350 INFO:teuthology.orchestra.run.smithi079.stdout:3611 read 0x685532a thru 0x686517e (0xfe55 bytes) 2024-09-21T13:59:31.350 INFO:teuthology.orchestra.run.smithi079.stdout:3612 read 0x1c2dfe6 thru 0x1c3b4ab (0xd4c6 bytes) 2024-09-21T13:59:31.350 INFO:teuthology.orchestra.run.smithi079.stdout:3614 read 0x291a5cb thru 0x292302b (0x8a61 bytes) 2024-09-21T13:59:31.370 INFO:teuthology.orchestra.run.smithi079.stdout:3616 trunc from 0xc24971b to 0x960703 2024-09-21T13:59:31.396 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:31.393+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:31.413 INFO:teuthology.orchestra.run.smithi079.stdout:3617 write 0x98ad108 thru 0x98ad413 (0x30c bytes) 2024-09-21T13:59:31.417 INFO:teuthology.orchestra.run.smithi079.stdout:3618 clone 26 order 24 su 4194304 sc 5 2024-09-21T13:59:31.418 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.418 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:31.527 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:31.525+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:31.598 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:31.596+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:31.603 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.603 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:31.703 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:31.701+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:31.780 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.780 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.794 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:31.835 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:31.833+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:31.901 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:31.900+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:31.957 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:31.957 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:31.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:32.019 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:32.017+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:32.088 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.089 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.103 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:32.104 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:32.104+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:32.204 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:32.204+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:32.274 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.275 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.289 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:32.305 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:32.304+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:32.320 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:59:32.406 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:32.404+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:32.411 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.412 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:32.507 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:32.504+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:32.553 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.553 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:32.611 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:32.609+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:32.682 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.682 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:32.744 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:32.744+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:32.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:32.812+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:32.835 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.835 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:32.851 INFO:teuthology.orchestra.run.smithi079.stdout:flattening image image_client.0-clone25 2024-09-21T13:59:32.913 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:32.913+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:32.976 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:32.976 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:32.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:33.035 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:33.036+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:33.114 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:33.109+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:33.122 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:33.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:33.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:33.215 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:33.213+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:33.239 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-21T13:59:33.286 INFO:teuthology.orchestra.run.smithi079.stdout:3619 writesame 0xad26220 thru 0xad28493 data_size 0xf(0x2274 bytes) 2024-09-21T13:59:33.286 INFO:teuthology.orchestra.run.smithi079.stdout:3620 punch from 0x99f6be to 0x9a166e, (0x1fb0 bytes) 2024-09-21T13:59:33.286 INFO:teuthology.orchestra.run.smithi079.stdout:3621 punch from 0xc17397 to 0xc25b05, (0xe76e bytes) 2024-09-21T13:59:33.286 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:33.286 INFO:teuthology.orchestra.run.smithi079.stdout:3623 write 0xa465f83 thru 0xa4682a9 (0x2327 bytes) 2024-09-21T13:59:33.291 INFO:teuthology.orchestra.run.smithi079.stdout:3624 punch from 0x59771bb to 0x597dee6, (0x6d2b bytes) 2024-09-21T13:59:33.291 INFO:teuthology.orchestra.run.smithi079.stdout:3625 read 0x327ad61 thru 0x3287b67 (0xce07 bytes) 2024-09-21T13:59:33.291 INFO:teuthology.orchestra.run.smithi079.stdout:3626 read 0x40b31ff thru 0x40c1207 (0xe009 bytes) 2024-09-21T13:59:33.291 INFO:teuthology.orchestra.run.smithi079.stdout:3627 read 0x3c5d169 thru 0x3c6968c (0xc524 bytes) 2024-09-21T13:59:33.291 INFO:teuthology.orchestra.run.smithi079.stdout:3630 writesame 0x228ccc5 thru 0x229aca4 data_size 0x60(0xdfe0 bytes) 2024-09-21T13:59:33.297 INFO:teuthology.orchestra.run.smithi079.stdout:3632 read 0x9cd863d thru 0x9cdf4d4 (0x6e98 bytes) 2024-09-21T13:59:33.307 INFO:teuthology.orchestra.run.smithi079.stdout:3634 write 0xbb3bd7e thru 0xbb3bec0 (0x143 bytes) 2024-09-21T13:59:33.309 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:33.309 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:33.316 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:33.313+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:33.316 INFO:teuthology.orchestra.run.smithi079.stdout:3636 trunc from 0xbb3bec1 to 0x73ce2da 2024-09-21T13:59:33.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:33.339 INFO:teuthology.orchestra.run.smithi079.stdout:3637 punch from 0x346b27b to 0x34764b5, (0xb23a bytes) 2024-09-21T13:59:33.342 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:33.342 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:33.349 INFO:teuthology.orchestra.run.smithi079.stdout:3639 trunc from 0x73ce2da to 0xc6a056 2024-09-21T13:59:33.363 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:33.363 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:33.381 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:33.381 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:33.399 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:33.399 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:33.407 INFO:teuthology.orchestra.run.smithi079.stdout:3640 writesame 0x4e21bdb thru 0x4e24f6a data_size 0x37(0x3390 bytes) 2024-09-21T13:59:33.407 INFO:teuthology.orchestra.run.smithi079.stdout:3642 write 0x2c42012 thru 0x2c4a434 (0x8423 bytes) 2024-09-21T13:59:33.410 INFO:teuthology.orchestra.run.smithi079.stdout:3644 read 0x1e8117d thru 0x1e85cf5 (0x4b79 bytes) 2024-09-21T13:59:33.410 INFO:teuthology.orchestra.run.smithi079.stdout:3645 writesame 0x3dcf77e thru 0x3dde3bd data_size 0x10(0xec40 bytes) 2024-09-21T13:59:33.417 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:33.413+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:33.417 INFO:teuthology.orchestra.run.smithi079.stdout:3646 read 0x47c67eb thru 0x47cf56c (0x8d82 bytes) 2024-09-21T13:59:33.418 INFO:teuthology.orchestra.run.smithi079.stdout:3647 punch from 0x495ae36 to 0x4969106, (0xe2d0 bytes) 2024-09-21T13:59:33.418 INFO:teuthology.orchestra.run.smithi079.stdout:3648 write 0x3210dd0 thru 0x321871a (0x794b bytes) 2024-09-21T13:59:33.421 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:33.421 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:33.421 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:33.442 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:33.443 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:3653 writesame 0xedb8f1c thru 0xedc173a data_size 0x1(0x881f bytes) 2024-09-21T13:59:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:3656 read 0xad1824b thru 0xad1be42 (0x3bf8 bytes) 2024-09-21T13:59:33.445 INFO:teuthology.orchestra.run.smithi079.stdout:3660 read 0x4df9562 thru 0x4e03a51 (0xa4f0 bytes) 2024-09-21T13:59:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:3662 punch from 0x91b7be to 0x9291a1, (0xd9e3 bytes) 2024-09-21T13:59:33.446 INFO:teuthology.orchestra.run.smithi079.stdout:3663 clone 27 order 21 su 8192 sc 5 2024-09-21T13:59:33.463 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:33.463 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:33.463 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:33.466 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:33.467 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:33.472 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:33.472 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:33.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:33.518 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:33.513+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:33.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:33.616+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.816771743000004, 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.676748302999997, 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.648489298000001, 2024-09-21T13:59:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.751380752999999, 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.751319283999997, 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.743148533999999, 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:59:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:59:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742255309000001, 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742197548999997, 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742178957, 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742166619000002, 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742144883000002, 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742121699999998, 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742101271000003, 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742086473000001, 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:33.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742061888999999, 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:33.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:33.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742045193000003, 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:33.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.742022956, 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.823734653000002, 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.654216105000003, 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.290977511000001, 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:33.774 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:33.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:33.776 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:33.773+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:33.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:33.876+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:33.952 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:33.952 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:33.952 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:33.952 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:33.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:33.977 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:33.973+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:34.078 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:34.076+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:34.133 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:34.133 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:34.133 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:34.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:34.179 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:34.177+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:34.282 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:34.280+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.791022888999997, 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:34.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:34.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790911266000002, 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:34.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:34.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790891443, 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:34.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:34.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790867263999999, 2024-09-21T13:59:34.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:34.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790843158999998, 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790824649999998, 2024-09-21T13:59:34.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:34.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790814908000002, 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.343 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:34.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790790049000002, 2024-09-21T13:59:34.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:34.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790761371999999, 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:34.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790742553999998, 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:34.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:34.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790721883000003, 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:34.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790700811999997, 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:34.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790664960000001, 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:34.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:34.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790632737999999, 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790597097999999, 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:34.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:34.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790562620000003, 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:34.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:34.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790508060000001, 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.394 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:34.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790468894999997, 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.403 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790430159000003, 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:34.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:34.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.790405405999998, 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:34.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.413 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:34.413 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:34.413 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:34.414 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-21T13:59:34.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-21T13:59:34.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:59:34.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:34.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:34.416+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:34.451 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone26 from 0xedc173b (overlap 0xc6a056) to 0x0 2024-09-21T13:59:34.517 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:34.513+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:34.542 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-21T13:59:34.617 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:34.613+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:34.625 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:34.625 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:34.625 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:34.625 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:34.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:34.719 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:34.716+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:34.761 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:34.761 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:34.761 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:34.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:34.815 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T13:59:34.812+0000 7f74c16a6640 -1 mon.a@0(leader).osd e76 definitely_dead 0 2024-09-21T13:59:34.834 INFO:teuthology.orchestra.run.smithi079.stdout:3664 write 0xa98587e thru 0xa991521 (0xbca4 bytes) 2024-09-21T13:59:34.834 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:34.832+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:34.850 INFO:teuthology.orchestra.run.smithi079.stdout:3665 writesame 0x5e76abe thru 0x5e7dca1 data_size 0x4a(0x71e4 bytes) 2024-09-21T13:59:34.859 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:34.859 INFO:teuthology.orchestra.run.smithi079.stdout:3667 writesame 0x1f777d9 thru 0x1f7d3d7 data_size 0x1(0x5bff bytes) 2024-09-21T13:59:34.921 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:34.917+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:34.945 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:34.945 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:34.946 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.542057440000001, 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:34.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:34.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:34.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.501970602, 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.958 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:34.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:34.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:34.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:34.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.440657346000002, 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:34.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:34.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:34.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133358 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 76800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132452651000001, 2024-09-21T13:59:34.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058918719000000001, 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.980 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133358 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811181+0000", 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811185+0000", 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811193+0000", 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1289999999999996e-06 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811200+0000", 2024-09-21T13:59:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7129999999999999e-06 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869833+0000", 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058633115999999999 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869948+0000", 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115584 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870101+0000", 2024-09-21T13:59:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152287 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133359 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132429182999999, 2024-09-21T13:59:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059286298000000001, 2024-09-21T13:59:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133359 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811205+0000", 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811208+0000", 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2729999999999998e-06 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811216+0000", 2024-09-21T13:59:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.259e-06 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811223+0000", 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6259999999999997e-06 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870168+0000", 2024-09-21T13:59:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058945164000000001 2024-09-21T13:59:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870311+0000", 2024-09-21T13:59:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142464 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870492+0000", 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181118 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133360 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 87040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132406047000003, 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059596781000000001, 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133360 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811228+0000", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811231+0000", 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.196e-06 2024-09-21T13:59:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811239+0000", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811246+0000", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6100000000000002e-06 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870555+0000", 2024-09-21T13:59:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059309029999999999 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870673+0000", 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118363 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870825+0000", 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015213600000000001 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133361 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 92160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132383206, 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059958546000000001, 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133361 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811254+0000", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.337e-06 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811262+0000", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1659999999999994e-06 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811269+0000", 2024-09-21T13:59:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5930000000000002e-06 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870893+0000", 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059623968999999999 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871028+0000", 2024-09-21T13:59:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135501 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871210+0000", 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018161699999999999 2024-09-21T13:59:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133362 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 97280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132359874000002, 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060278945, 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133362 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811274+0000", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811277+0000", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000001e-06 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811285+0000", 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9119999999999998e-06 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811292+0000", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6200000000000001e-06 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871273+0000", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059980588000000001 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871400+0000", 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127525 2024-09-21T13:59:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871554+0000", 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015371300000000001 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133363 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 103424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132322307000003, 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060623992000000002, 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133363 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811315+0000", 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3529999999999999e-06 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811324+0000", 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5089999999999993e-06 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811330+0000", 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871620+0000", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060289397000000002 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871753+0000", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132908 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871936+0000", 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000183881 2024-09-21T13:59:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133364 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132298745, 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060935982, 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133364 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811335+0000", 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811339+0000", 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2229999999999999e-06 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811347+0000", 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2730000000000002e-06 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811353+0000", 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5989999999999998e-06 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871999+0000", 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060645731000000001 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872119+0000", 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119867 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872272+0000", 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015293199999999999 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133365 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 113664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.13227552, 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.06130443, 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133365 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811362+0000", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2160000000000002e-06 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811370+0000", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811376+0000", 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3799999999999999e-06 2024-09-21T13:59:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872342+0000", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060965424999999997 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872482+0000", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014024400000000001 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872664+0000", 2024-09-21T13:59:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018166499999999999 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133366 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 118784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132252590999997, 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061625971000000002, 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133366 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811385+0000", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.332e-06 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811393+0000", 2024-09-21T13:59:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170000000000004e-06 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811400+0000", 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6889999999999998e-06 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872726+0000", 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061325932999999999 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872856+0000", 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130588 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873008+0000", 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000151905 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133367 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 123904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132229393000003, 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061995883000000002, 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133367 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811408+0000", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.14e-06 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811416+0000", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0490000000000004e-06 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811422+0000", 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873082+0000", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061659985 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873224+0000", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014196400000000001 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873401+0000", 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017682099999999999 2024-09-21T13:59:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133368 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 129024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132206678000003, 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062336753000000002, 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133368 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811427+0000", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811454+0000", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6825000000000002e-05 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811464+0000", 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5990000000000008e-06 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811471+0000", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873463+0000", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061991549 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873609+0000", 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014674999999999999 2024-09-21T13:59:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873765+0000", 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155456 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133369 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 135168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132157444000001, 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062595426999999995, 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133369 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811480+0000", 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.18e-06 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811488+0000", 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811495+0000", 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.686e-06 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873807+0000", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062312233000000002 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873921+0000", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113486 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874073+0000", 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152156 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133370 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 140288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132134139000001, 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063038644000000005, 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133370 2024-09-21T13:59:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811500+0000", 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811503+0000", 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5020000000000001e-06 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811512+0000", 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811518+0000", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7660000000000001e-06 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874173+0000", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062654177000000005 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874335+0000", 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016219499999999999 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874539+0000", 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133371 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 145408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132110750999999, 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0633967, 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133371 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811523+0000", 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811527+0000", 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811535+0000", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811542+0000", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874635+0000", 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063093623000000001 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874762+0000", 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012691199999999999 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874921+0000", 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848899999999999 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133372 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 150528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132087431999999, 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063676675000000002, 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133372 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811550+0000", 2024-09-21T13:59:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1889999999999999e-06 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811558+0000", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1769999999999998e-06 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811565+0000", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874963+0000", 2024-09-21T13:59:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063398191000000007 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875075+0000", 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011169499999999999 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875224+0000", 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014938700000000001 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133373 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132062253999997, 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064102759999999995, 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133373 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811575+0000", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811583+0000", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4090000000000003e-06 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811590+0000", 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0559999999999999e-06 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875318+0000", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063727151999999995 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875477+0000", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015933500000000001 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875675+0000", 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019835400000000001 2024-09-21T13:59:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133374 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 160768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.132035561999999, 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064394145999999999, 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133374 2024-09-21T13:59:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811598+0000", 2024-09-21T13:59:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811603+0000", 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2499999999999997e-06 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811619+0000", 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5736e-05 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811633+0000", 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3862e-05 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875721+0000", 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064088110000000004 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875838+0000", 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116801 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875993+0000", 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015558400000000001 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:35.063 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:35.065 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:35.065 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:35.064+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:35.099 INFO:teuthology.orchestra.run.smithi079.stdout:3669 punch from 0x7117968 to 0x71182a2, (0x93a bytes) 2024-09-21T13:59:35.099 INFO:teuthology.orchestra.run.smithi079.stdout:3670 read 0xb0ed414 thru 0xb0f245d (0x504a bytes) 2024-09-21T13:59:35.099 INFO:teuthology.orchestra.run.smithi079.stdout:3671 write 0x3641224 thru 0x3641235 (0x12 bytes) 2024-09-21T13:59:35.125 INFO:teuthology.orchestra.run.smithi079.stdout:3673 write 0x4f8d995 thru 0x4f983d5 (0xaa41 bytes) 2024-09-21T13:59:35.166 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:35.161+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185195 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136036+0000", 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063819143999999994, 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063859399999999997, 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185195 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136036+0000", 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136036+0000", 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136035+0000", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136038+0000", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8700000000000001e-06 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136045+0000", 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4730000000000003e-06 2024-09-21T13:59:35.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136051+0000", 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.032e-06 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185227 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136665+0000", 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063189227000000001, 2024-09-21T13:59:35.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063331619000000006, 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185227 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136665+0000", 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136665+0000", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136665+0000", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136668+0000", 2024-09-21T13:59:35.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6000000000000001e-06 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136675+0000", 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5809999999999999e-06 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136681+0000", 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8610000000000003e-06 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185259 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143825+0000", 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056030032, 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056256041, 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185259 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143825+0000", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143825+0000", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143824+0000", 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143826+0000", 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.655e-06 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143830+0000", 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.76e-06 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143833+0000", 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4180000000000001e-06 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185343 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156083+0000", 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043772115, 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044081025000000003, 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185343 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156083+0000", 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156083+0000", 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156082+0000", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156085+0000", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000002e-06 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156092+0000", 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0180000000000004e-06 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156098+0000", 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6219999999999997e-06 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185375 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167631+0000", 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032223622, 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.032613506, 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185375 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167631+0000", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167631+0000", 2024-09-21T13:59:35.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164340+0000", 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9967089 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167636+0000", 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003296135 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167647+0000", 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1078e-05 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167654+0000", 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1630000000000001e-06 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185406 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179920+0000", 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019934552000000001, 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020407740000000001, 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185406 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179920+0000", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179920+0000", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179920+0000", 2024-09-21T13:59:35.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179922+0000", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1780000000000002e-06 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179926+0000", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5770000000000004e-06 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179930+0000", 2024-09-21T13:59:35.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6619999999999998e-06 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185489 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191806+0000", 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080487690000000008, 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086016700000000005, 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185489 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191806+0000", 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191806+0000", 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191806+0000", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191807+0000", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6929999999999999e-06 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191811+0000", 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3809999999999999e-06 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191814+0000", 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3720000000000001e-06 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185196 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136057+0000", 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063798079999999993, 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064436688000000006, 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185196 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136057+0000", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136057+0000", 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136056+0000", 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136059+0000", 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6010000000000002e-06 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136066+0000", 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6249999999999998e-06 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136072+0000", 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0059999999999998e-06 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185228 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136686+0000", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063168584, 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063887509999999995, 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185228 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136686+0000", 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136686+0000", 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136686+0000", 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136688+0000", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5940000000000001e-06 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136697+0000", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2670000000000006e-06 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136703+0000", 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9340000000000003e-06 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185260 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143836+0000", 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056018654000000001, 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056820451000000001, 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185260 2024-09-21T13:59:35.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143836+0000", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143836+0000", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143836+0000", 2024-09-21T13:59:35.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143837+0000", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.578e-06 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143841+0000", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6849999999999999e-06 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143844+0000", 2024-09-21T13:59:35.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2990000000000001e-06 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185344 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156102+0000", 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043752878000000002, 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044634878000000003, 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185344 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156102+0000", 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156102+0000", 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156101+0000", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156104+0000", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4710000000000001e-06 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156111+0000", 2024-09-21T13:59:35.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.674e-06 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156116+0000", 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4739999999999996e-06 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185376 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167659+0000", 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032195886999999999, 2024-09-21T13:59:35.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033201162999999999, 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185376 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167659+0000", 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167659+0000", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167658+0000", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167661+0000", 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1849999999999998e-06 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167665+0000", 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8959999999999996e-06 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167668+0000", 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.061e-06 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185407 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179934+0000", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019920522999999999, 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021019003000000001, 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185407 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179934+0000", 2024-09-21T13:59:35.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179934+0000", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179934+0000", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179936+0000", 2024-09-21T13:59:35.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9630000000000001e-06 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179939+0000", 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5880000000000002e-06 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179942+0000", 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9069999999999999e-06 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185490 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191816+0000", 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080382790000000006, 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092186030000000006, 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185490 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191816+0000", 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191816+0000", 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191816+0000", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191818+0000", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3829999999999999e-06 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191821+0000", 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3890000000000001e-06 2024-09-21T13:59:35.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191824+0000", 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1439999999999999e-06 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185197 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136090+0000", 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063764893000000003, 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065029966999999994, 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185197 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136090+0000", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136090+0000", 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136089+0000", 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136093+0000", 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6210000000000001e-06 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136101+0000", 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4169999999999992e-06 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136109+0000", 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2250000000000003e-06 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185229 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136707+0000", 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063147551999999996, 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064495765999999996, 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185229 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136707+0000", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136707+0000", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136707+0000", 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136709+0000", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7690000000000001e-06 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136718+0000", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4440000000000008e-06 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136724+0000", 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2400000000000004e-06 2024-09-21T13:59:35.277 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185261 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143847+0000", 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056007416999999997, 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057436806, 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.278 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185261 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143847+0000", 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143847+0000", 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143847+0000", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143849+0000", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6950000000000001e-06 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143854+0000", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1370000000000001e-06 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143859+0000", 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5729999999999998e-06 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185345 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156120+0000", 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043734232999999997, 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.045244632, 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185345 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156120+0000", 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156120+0000", 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156120+0000", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156123+0000", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4530000000000001e-06 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156129+0000", 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3130000000000004e-06 2024-09-21T13:59:35.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156135+0000", 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7490000000000004e-06 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185377 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167670+0000", 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032184546000000001, 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033784092000000002, 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185377 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167670+0000", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167670+0000", 2024-09-21T13:59:35.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167670+0000", 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167676+0000", 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2020000000000001e-06 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167680+0000", 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6179999999999999e-06 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167683+0000", 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0000000000000001e-06 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185408 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179945+0000", 2024-09-21T13:59:35.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019909525000000001, 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021589502, 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185408 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179945+0000", 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179945+0000", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179945+0000", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179946+0000", 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4729999999999999e-06 2024-09-21T13:59:35.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179950+0000", 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4230000000000001e-06 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179953+0000", 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0920000000000002e-06 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185491 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191826+0000", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080282640000000002, 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097924380000000005, 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185491 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191826+0000", 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191826+0000", 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191826+0000", 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191828+0000", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.415e-06 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191831+0000", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3050000000000001e-06 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191834+0000", 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9890000000000001e-06 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185198 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136114+0000", 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063740464999999996, 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065587092999999999, 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185198 2024-09-21T13:59:35.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136114+0000", 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136114+0000", 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136114+0000", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136117+0000", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.101e-06 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136125+0000", 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9219999999999997e-06 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136131+0000", 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2310000000000001e-06 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185230 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136729+0000", 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063125513999999994, 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065053093000000006, 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185230 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136729+0000", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136729+0000", 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136729+0000", 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136731+0000", 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5940000000000001e-06 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136739+0000", 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1999999999999997e-06 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136744+0000", 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5199999999999997e-06 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185262 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143864+0000", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.055990341999999999, 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057998788000000003, 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185262 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143864+0000", 2024-09-21T13:59:35.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143864+0000", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143864+0000", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143867+0000", 2024-09-21T13:59:35.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7700000000000002e-06 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143872+0000", 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.366e-06 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143875+0000", 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.292e-06 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185346 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156139+0000", 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043715678000000001, 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.045805106999999998, 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185346 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156139+0000", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156139+0000", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156139+0000", 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156141+0000", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6520000000000002e-06 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156149+0000", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6660000000000008e-06 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156154+0000", 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3249999999999998e-06 2024-09-21T13:59:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185378 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167685+0000", 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032169426000000001, 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034339175999999999, 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185378 2024-09-21T13:59:35.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167685+0000", 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167685+0000", 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167685+0000", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167687+0000", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.66e-06 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167690+0000", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3780000000000001e-06 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167693+0000", 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9490000000000001e-06 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185409 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179956+0000", 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019899090000000001, 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022149591, 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185409 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179956+0000", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179956+0000", 2024-09-21T13:59:35.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179955+0000", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179957+0000", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.575e-06 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179960+0000", 2024-09-21T13:59:35.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.433e-06 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179963+0000", 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7829999999999999e-06 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185492 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191836+0000", 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080184469999999997, 2024-09-21T13:59:35.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010348992, 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185492 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191836+0000", 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191836+0000", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191836+0000", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191838+0000", 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4619999999999999e-06 2024-09-21T13:59:35.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191841+0000", 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1559999999999999e-06 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191844+0000", 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9909999999999998e-06 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.316 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185199 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136136+0000", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063718883000000004, 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066133080999999996, 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185199 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136136+0000", 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136136+0000", 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136135+0000", 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136138+0000", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5830000000000001e-06 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136145+0000", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9609999999999999e-06 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136152+0000", 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-06 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185231 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136749+0000", 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063105619000000002, 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065602771000000004, 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185231 2024-09-21T13:59:35.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136749+0000", 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136749+0000", 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136749+0000", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136751+0000", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6639999999999998e-06 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136759+0000", 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3180000000000001e-06 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136765+0000", 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8760000000000002e-06 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185263 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143878+0000", 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.055976404, 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058554320999999999, 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185263 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143878+0000", 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143878+0000", 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143878+0000", 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143880+0000", 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6750000000000001e-06 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143884+0000", 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8959999999999996e-06 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143887+0000", 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.518e-06 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.326 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185347 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156159+0000", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043695695, 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046356008999999997, 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185347 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156159+0000", 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156159+0000", 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156159+0000", 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156161+0000", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4509999999999999e-06 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156168+0000", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7599999999999997e-06 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156173+0000", 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.329 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185379 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167695+0000", 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032159224, 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034900061000000003, 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185379 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167695+0000", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167695+0000", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167695+0000", 2024-09-21T13:59:35.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167697+0000", 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.536e-06 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167700+0000", 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2540000000000001e-06 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167703+0000", 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8439999999999998e-06 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185410 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179967+0000", 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019887992, 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022717823000000002, 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185410 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179967+0000", 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179967+0000", 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179966+0000", 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179968+0000", 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.452e-06 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179971+0000", 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3390000000000001e-06 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179974+0000", 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7269999999999999e-06 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185493 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191846+0000", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080088920000000001, 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010918574, 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185493 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191846+0000", 2024-09-21T13:59:35.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191846+0000", 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191846+0000", 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191847+0000", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.251e-06 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191850+0000", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3349999999999998e-06 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191853+0000", 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0010000000000002e-06 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185200 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136158+0000", 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063697084000000001, 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066704099000000003, 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185200 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136158+0000", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136158+0000", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136157+0000", 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136160+0000", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.802e-06 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136168+0000", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4730000000000003e-06 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136174+0000", 2024-09-21T13:59:35.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0979999999999999e-06 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185232 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136769+0000", 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063085423000000002, 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066174225000000003, 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185232 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136769+0000", 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136769+0000", 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136769+0000", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136771+0000", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5110000000000002e-06 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136779+0000", 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2030000000000003e-06 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136784+0000", 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8039999999999998e-06 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185264 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.144140+0000", 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.055714483000000002, 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058884073000000002, 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185264 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144140+0000", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144140+0000", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143889+0000", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9997492 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144152+0000", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026224100000000003 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144158+0000", 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8839999999999999e-06 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144162+0000", 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2740000000000001e-06 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185348 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156177+0000", 2024-09-21T13:59:35.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043677250000000001, 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046928584000000002, 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185348 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156177+0000", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156177+0000", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156177+0000", 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156179+0000", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2400000000000002e-06 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156187+0000", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156192+0000", 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.989e-06 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.352 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185380 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167705+0000", 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032149556000000003, 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035481707000000001, 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185380 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167705+0000", 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167705+0000", 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167705+0000", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167706+0000", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.319e-06 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167710+0000", 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3380000000000001e-06 2024-09-21T13:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167712+0000", 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8509999999999999e-06 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185411 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179976+0000", 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019878290999999999, 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023290152000000001, 2024-09-21T13:59:35.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185411 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179976+0000", 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179976+0000", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179976+0000", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179978+0000", 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.403e-06 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179981+0000", 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.366e-06 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179984+0000", 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2270000000000002e-06 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.359 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185494 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191856+0000", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079991690000000004, 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011490498, 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185494 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191856+0000", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191856+0000", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191855+0000", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191857+0000", 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191860+0000", 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.315e-06 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191863+0000", 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8899999999999999e-06 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.362 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185201 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136186+0000", 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063669165999999999, 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067243531999999995, 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185201 2024-09-21T13:59:35.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136186+0000", 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136186+0000", 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136185+0000", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136188+0000", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9459999999999998e-06 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136198+0000", 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6469999999999993e-06 2024-09-21T13:59:35.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136205+0000", 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8510000000000001e-06 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185233 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136804+0000", 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063050635999999993, 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066706499000000002, 2024-09-21T13:59:35.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.367 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.367 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.369 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185233 2024-09-21T13:59:35.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136804+0000", 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136804+0000", 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136803+0000", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136807+0000", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9940000000000002e-06 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136815+0000", 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9980000000000003e-06 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136822+0000", 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6719999999999998e-06 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185265 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.144864+0000", 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.054990797000000001, 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058730000999999997, 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185265 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144864+0000", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144864+0000", 2024-09-21T13:59:35.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144166+0000", 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9993014 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144867+0000", 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070123500000000003 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144874+0000", 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.328e-06 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144879+0000", 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5059999999999997e-06 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185349 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156196+0000", 2024-09-21T13:59:35.375 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043658414999999999, 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047495471999999997, 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185349 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156196+0000", 2024-09-21T13:59:35.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156196+0000", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156196+0000", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156198+0000", 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4229999999999999e-06 2024-09-21T13:59:35.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156205+0000", 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5479999999999998e-06 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156210+0000", 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1880000000000001e-06 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185381 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167715+0000", 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032140047999999997, 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.036060472000000003, 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185381 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167715+0000", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167715+0000", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167714+0000", 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167716+0000", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.454e-06 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167719+0000", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3280000000000002e-06 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167722+0000", 2024-09-21T13:59:35.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8600000000000001e-06 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185412 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179987+0000", 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019868144000000001, 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023869052000000002, 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.382 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185412 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179987+0000", 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179987+0000", 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179986+0000", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179988+0000", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.37e-06 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179991+0000", 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2559999999999998e-06 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179994+0000", 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.757e-06 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185495 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191866+0000", 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079888379999999998, 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012068904, 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185495 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191866+0000", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191866+0000", 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191866+0000", 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191867+0000", 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3599999999999999e-06 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191870+0000", 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2770000000000001e-06 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191873+0000", 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8430000000000001e-06 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185202 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.388 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136210+0000", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063644776, 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067806722, 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185202 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136210+0000", 2024-09-21T13:59:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136210+0000", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136209+0000", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136213+0000", 2024-09-21T13:59:35.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.101e-06 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136220+0000", 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2119999999999997e-06 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136226+0000", 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7780000000000004e-06 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185234 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136827+0000", 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063027526, 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067269906000000004, 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185234 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136827+0000", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136827+0000", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136827+0000", 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136829+0000", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5450000000000002e-06 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136836+0000", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9430000000000003e-06 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136843+0000", 2024-09-21T13:59:35.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9659999999999999e-06 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185266 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.145047+0000", 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.054807865999999997, 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059131129999999997, 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185266 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145047+0000", 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145047+0000", 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.144882+0000", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9998355 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145050+0000", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000167417 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145056+0000", 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1789999999999996e-06 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145061+0000", 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5549999999999996e-06 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185350 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156215+0000", 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043639870999999997, 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048045408999999997, 2024-09-21T13:59:35.398 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185350 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156215+0000", 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156215+0000", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156214+0000", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156217+0000", 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2699999999999999e-06 2024-09-21T13:59:35.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156223+0000", 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3589999999999996e-06 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156228+0000", 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1290000000000004e-06 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.401 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185382 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167724+0000", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032130287, 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.036616949000000003, 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185382 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167724+0000", 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167724+0000", 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167724+0000", 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167726+0000", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3790000000000001e-06 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167729+0000", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2559999999999998e-06 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167732+0000", 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8540000000000001e-06 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.404 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185413 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179996+0000", 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019858404, 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024424326999999999, 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185413 2024-09-21T13:59:35.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179996+0000", 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179996+0000", 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179996+0000", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180003+0000", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.092e-06 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180007+0000", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180010+0000", 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8820000000000001e-06 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185496 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191876+0000", 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079790610000000008, 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012624537999999999, 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185496 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191876+0000", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191876+0000", 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191875+0000", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191877+0000", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4130000000000001e-06 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191880+0000", 2024-09-21T13:59:35.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2629999999999999e-06 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191883+0000", 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.886e-06 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185203 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136231+0000", 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063623568000000005, 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068351718000000006, 2024-09-21T13:59:35.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185203 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136231+0000", 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136231+0000", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136231+0000", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136234+0000", 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9340000000000002e-06 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136240+0000", 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136246+0000", 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8139999999999997e-06 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185235 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136848+0000", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063006580000000006, 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067815427999999997, 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185235 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136848+0000", 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136848+0000", 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136848+0000", 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136850+0000", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7860000000000001e-06 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136857+0000", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0110000000000003e-06 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136864+0000", 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1340000000000001e-06 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185267 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.147925+0000", 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051929779000000002, 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056819527000000002, 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185267 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147925+0000", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147925+0000", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.145064+0000", 2024-09-21T13:59:35.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9971395 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147931+0000", 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028660410000000002 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147942+0000", 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1909999999999999e-05 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147951+0000", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5099999999999998e-06 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185351 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160072+0000", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039782289999999998, 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.044756485999999998, 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185351 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160072+0000", 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160072+0000", 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156233+0000", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.99616 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160077+0000", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038443980000000002 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160092+0000", 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5489999999999999e-05 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160098+0000", 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.626e-06 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185383 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167734+0000", 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032120458999999997, 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037177448000000002, 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185383 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167734+0000", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167734+0000", 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167734+0000", 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167736+0000", 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.491e-06 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167739+0000", 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3780000000000001e-06 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167742+0000", 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6110000000000001e-06 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185414 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.180012+0000", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019842432, 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024978922000000001, 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185414 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180012+0000", 2024-09-21T13:59:35.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180012+0000", 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180012+0000", 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180014+0000", 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6959999999999999e-06 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180017+0000", 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3909999999999998e-06 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180020+0000", 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9679999999999998e-06 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185497 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191886+0000", 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079686110000000004, 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013185528, 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185497 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191886+0000", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191886+0000", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191886+0000", 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191887+0000", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.409e-06 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191891+0000", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3519999999999998e-06 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191893+0000", 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.819e-06 2024-09-21T13:59:35.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185204 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136251+0000", 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063603638000000004, 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068902068999999996, 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185204 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136251+0000", 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136251+0000", 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136251+0000", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136253+0000", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6110000000000001e-06 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136263+0000", 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7000000000000003e-06 2024-09-21T13:59:35.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136287+0000", 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3649999999999999e-05 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185236 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136869+0000", 2024-09-21T13:59:35.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062985852999999994, 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068365508000000005, 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185236 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136869+0000", 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136869+0000", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136868+0000", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136871+0000", 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9510000000000002e-06 2024-09-21T13:59:35.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136878+0000", 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.917e-06 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136884+0000", 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6470000000000003e-06 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185268 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.147959+0000", 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051895932999999998, 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057355921999999997, 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185268 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147959+0000", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147959+0000", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147958+0000", 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147961+0000", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147968+0000", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.092e-06 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147974+0000", 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9320000000000001e-06 2024-09-21T13:59:35.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185352 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160122+0000", 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039732647000000003, 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.045274666999999998, 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185352 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160122+0000", 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160122+0000", 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160121+0000", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160131+0000", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0094e-05 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160139+0000", 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7640000000000005e-06 2024-09-21T13:59:35.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160145+0000", 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185384 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167744+0000", 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032110851000000003, 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037736780999999997, 2024-09-21T13:59:35.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185384 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167744+0000", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167744+0000", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167744+0000", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167745+0000", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.389e-06 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167748+0000", 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2339999999999999e-06 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167751+0000", 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8590000000000001e-06 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185415 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.183902+0000", 2024-09-21T13:59:35.450 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015952639000000001, 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02165825, 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185415 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183902+0000", 2024-09-21T13:59:35.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183902+0000", 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.180023+0000", 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9961205 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183906+0000", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038832340000000002 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183913+0000", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8929999999999999e-06 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183917+0000", 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0790000000000002e-06 2024-09-21T13:59:35.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185498 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191896+0000", 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079588509999999994, 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013745195999999999, 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185498 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191896+0000", 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191896+0000", 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191896+0000", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191897+0000", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.378e-06 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191900+0000", 2024-09-21T13:59:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2710000000000001e-06 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191903+0000", 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8449999999999999e-06 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185205 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136292+0000", 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063562645000000001, 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069584701999999998, 2024-09-21T13:59:35.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185205 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136292+0000", 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136292+0000", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136292+0000", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136294+0000", 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8370000000000001e-06 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136300+0000", 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5829999999999997e-06 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136304+0000", 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.49e-06 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185237 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136889+0000", 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062965831, 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069069884999999998, 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185237 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136889+0000", 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136889+0000", 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136888+0000", 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136891+0000", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.621e-06 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136899+0000", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4970000000000004e-06 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136904+0000", 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6799999999999998e-06 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185269 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.147979+0000", 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051875760999999999, 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058067092000000001, 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185269 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147979+0000", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147979+0000", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147979+0000", 2024-09-21T13:59:35.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147981+0000", 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.61e-06 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147988+0000", 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3389999999999998e-06 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147993+0000", 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3979999999999998e-06 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185353 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160150+0000", 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039704572, 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.045976677000000001, 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.467 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185353 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160150+0000", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160150+0000", 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160150+0000", 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160152+0000", 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.615e-06 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160160+0000", 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9149999999999996e-06 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160165+0000", 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1510000000000003e-06 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185385 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.167753+0000", 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.032101301999999998, 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038457973999999999, 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185385 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167753+0000", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167753+0000", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167753+0000", 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167755+0000", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3570000000000001e-06 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167758+0000", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3210000000000001e-06 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167761+0000", 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7319999999999998e-06 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185416 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.183942+0000", 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015913158, 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022353207, 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185416 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183942+0000", 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183942+0000", 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183941+0000", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183943+0000", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-06 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183947+0000", 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.211e-06 2024-09-21T13:59:35.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183950+0000", 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1030000000000002e-06 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185499 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195703+0000", 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0041512789999999999, 2024-09-21T13:59:35.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010676099, 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185499 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195703+0000", 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195703+0000", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191905+0000", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.996202 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195708+0000", 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038021130000000002 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195717+0000", 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9280000000000005e-06 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195724+0000", 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3459999999999999e-06 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185206 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136306+0000", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063548246000000003, 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070156257, 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185206 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136306+0000", 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136306+0000", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136306+0000", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136308+0000", 2024-09-21T13:59:35.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8500000000000001e-06 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136312+0000", 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7309999999999999e-06 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136315+0000", 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999998e-06 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185238 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136909+0000", 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062945291, 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069638064999999999, 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185238 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136909+0000", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136909+0000", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136909+0000", 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136912+0000", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6599999999999999e-06 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136919+0000", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9720000000000003e-06 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136925+0000", 2024-09-21T13:59:35.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6030000000000001e-06 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185270 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.147997+0000", 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051857370999999999, 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058632706, 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185270 2024-09-21T13:59:35.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147997+0000", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147997+0000", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.147997+0000", 2024-09-21T13:59:35.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148000+0000", 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6510000000000001e-06 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148006+0000", 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5320000000000003e-06 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148011+0000", 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1150000000000002e-06 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185354 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160170+0000", 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039684434999999997, 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.046540227000000003, 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185354 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160170+0000", 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160170+0000", 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160170+0000", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160172+0000", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5110000000000002e-06 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160179+0000", 2024-09-21T13:59:35.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5710000000000003e-06 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160184+0000", 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4310000000000002e-06 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185417 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.183982+0000", 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015872857000000001, 2024-09-21T13:59:35.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02281356, 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185417 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183982+0000", 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183982+0000", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183982+0000", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183983+0000", 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6500000000000001e-06 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183988+0000", 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1789999999999999e-06 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183992+0000", 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5939999999999998e-06 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185500 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195754+0000", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0041006899999999997, 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011121697, 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185500 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195754+0000", 2024-09-21T13:59:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195754+0000", 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195753+0000", 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195757+0000", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1860000000000001e-06 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195766+0000", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4930000000000004e-06 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195772+0000", 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.84e-06 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185207 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136319+0000", 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063535539000000002, 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070643203000000002, 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185207 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136319+0000", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136319+0000", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136319+0000", 2024-09-21T13:59:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136321+0000", 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7540000000000001e-06 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136324+0000", 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8e-06 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136328+0000", 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3960000000000002e-06 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185239 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136930+0000", 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062924933000000002, 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070113546999999998, 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185239 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136930+0000", 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136930+0000", 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136929+0000", 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136932+0000", 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.931e-06 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136940+0000", 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3969999999999997e-06 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136945+0000", 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7849999999999997e-06 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185271 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.148016+0000", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051838644000000003, 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059111535, 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185271 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148016+0000", 2024-09-21T13:59:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148016+0000", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148016+0000", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148018+0000", 2024-09-21T13:59:35.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3630000000000001e-06 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148025+0000", 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.601e-06 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148030+0000", 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0069999999999997e-06 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185355 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160189+0000", 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039665935999999999, 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047019178000000002, 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185355 2024-09-21T13:59:35.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160189+0000", 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160189+0000", 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160188+0000", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160191+0000", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.255e-06 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160197+0000", 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5239999999999997e-06 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160202+0000", 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.899e-06 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185386 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.171930+0000", 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027924241999999998, 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035366427999999998, 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185386 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.171930+0000", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.171930+0000", 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.167763+0000", 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9958324 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.171936+0000", 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041728570000000003 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.171945+0000", 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6439999999999995e-06 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.171951+0000", 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8250000000000001e-06 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185418 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.183995+0000", 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015859398, 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023382067999999999, 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185418 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183995+0000", 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183995+0000", 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183995+0000", 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.183997+0000", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.412e-06 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184000+0000", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-06 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184003+0000", 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8490000000000002e-06 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185501 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195777+0000", 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0040780419999999996, 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011683901999999999, 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185501 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195777+0000", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195777+0000", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195776+0000", 2024-09-21T13:59:35.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195785+0000", 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1209999999999996e-06 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195796+0000", 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0849999999999999e-05 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195802+0000", 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5790000000000003e-06 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185208 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136331+0000", 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063523621000000002, 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071212915000000002, 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185208 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136331+0000", 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136331+0000", 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136331+0000", 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136332+0000", 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5519999999999999e-06 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136337+0000", 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0089999999999998e-06 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136341+0000", 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4570000000000001e-06 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185240 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136950+0000", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062904531999999999, 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070695915999999998, 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185240 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136950+0000", 2024-09-21T13:59:35.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136950+0000", 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136950+0000", 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136953+0000", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7580000000000001e-06 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136960+0000", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2629999999999997e-06 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136966+0000", 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7370000000000003e-06 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185323 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.148035+0000", 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051820203000000002, 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059694694, 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185323 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148035+0000", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148035+0000", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148034+0000", 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148036+0000", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2630000000000002e-06 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148043+0000", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4489999999999996e-06 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148048+0000", 2024-09-21T13:59:35.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3070000000000002e-06 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185356 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160207+0000", 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039648094000000002, 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.047605319, 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185356 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160207+0000", 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160207+0000", 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160206+0000", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160209+0000", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3750000000000001e-06 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160215+0000", 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5420000000000002e-06 2024-09-21T13:59:35.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160220+0000", 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2379999999999997e-06 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185387 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172008+0000", 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027847022999999999, 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035890658999999998, 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185387 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172008+0000", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172008+0000", 2024-09-21T13:59:35.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172007+0000", 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172010+0000", 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172015+0000", 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9259999999999997e-06 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172020+0000", 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.211e-06 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185419 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.184005+0000", 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015849252000000001, 2024-09-21T13:59:35.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023976428000000001, 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185419 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184005+0000", 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184005+0000", 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184005+0000", 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184007+0000", 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5290000000000001e-06 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184012+0000", 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8500000000000002e-06 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184014+0000", 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.542 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185502 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195807+0000", 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.004047569, 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012261322, 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185502 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195807+0000", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195807+0000", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195807+0000", 2024-09-21T13:59:35.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195810+0000", 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8430000000000001e-06 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195816+0000", 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8700000000000003e-06 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195822+0000", 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4160000000000003e-06 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185209 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136344+0000", 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063511183999999998, 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071808271000000007, 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.546 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185209 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136344+0000", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136344+0000", 2024-09-21T13:59:35.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136343+0000", 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136360+0000", 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6310000000000001e-05 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136367+0000", 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0119999999999999e-06 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136371+0000", 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9639999999999997e-06 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185241 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136972+0000", 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062883084000000006, 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071265050999999996, 2024-09-21T13:59:35.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185241 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136972+0000", 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136972+0000", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136971+0000", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136974+0000", 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469999999999998e-06 2024-09-21T13:59:35.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136981+0000", 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136987+0000", 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1600000000000003e-06 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185324 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.148053+0000", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051801997000000002, 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.060265312000000001, 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185324 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148053+0000", 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148053+0000", 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148052+0000", 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148055+0000", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5459999999999998e-06 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148062+0000", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6880000000000002e-06 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148067+0000", 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2120000000000002e-06 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185357 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160225+0000", 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039629965000000003, 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048177909999999997, 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185357 2024-09-21T13:59:35.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160225+0000", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160225+0000", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160224+0000", 2024-09-21T13:59:35.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160227+0000", 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.39e-06 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160233+0000", 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5610000000000004e-06 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160239+0000", 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3480000000000003e-06 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185388 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172023+0000", 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027831696999999999, 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.036461795999999998, 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185388 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172023+0000", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172023+0000", 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172023+0000", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172025+0000", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7409999999999999e-06 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172028+0000", 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6449999999999998e-06 2024-09-21T13:59:35.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172031+0000", 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.835e-06 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185420 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.184017+0000", 2024-09-21T13:59:35.562 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015837797000000001, 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024554400000000001, 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185420 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184017+0000", 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184017+0000", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184017+0000", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184018+0000", 2024-09-21T13:59:35.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.61e-06 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184022+0000", 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.399e-06 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184025+0000", 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0750000000000002e-06 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185503 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195826+0000", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0040284910000000004, 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012825534, 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185503 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195826+0000", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195826+0000", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195826+0000", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195828+0000", 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4370000000000001e-06 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195835+0000", 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195840+0000", 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9880000000000004e-06 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185210 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136374+0000", 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063480634999999994, 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072364039000000005, 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185210 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136374+0000", 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136374+0000", 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136374+0000", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136376+0000", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.807e-06 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136380+0000", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1570000000000002e-06 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136383+0000", 2024-09-21T13:59:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2540000000000001e-06 2024-09-21T13:59:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.572 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185242 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.137004+0000", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062850534, 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071814952000000001, 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185242 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137004+0000", 2024-09-21T13:59:35.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137004+0000", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137004+0000", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137007+0000", 2024-09-21T13:59:35.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.478e-06 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137015+0000", 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1720000000000007e-06 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137023+0000", 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1620000000000008e-06 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185325 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.148071+0000", 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.051783346000000001, 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.060828754999999998, 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185325 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148071+0000", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148071+0000", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148071+0000", 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148074+0000", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6180000000000002e-06 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148080+0000", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4640000000000003e-06 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148085+0000", 2024-09-21T13:59:35.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2820000000000004e-06 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185358 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160243+0000", 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039611777000000001, 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048741653000000003, 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185358 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160243+0000", 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160243+0000", 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160243+0000", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160245+0000", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1629999999999999e-06 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160251+0000", 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:35.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160256+0000", 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9259999999999999e-06 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185389 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172033+0000", 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027821314, 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037033392999999998, 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185389 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172033+0000", 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172033+0000", 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172033+0000", 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172041+0000", 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172045+0000", 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172048+0000", 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185421 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.184027+0000", 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015827722999999998, 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025123656000000001, 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185421 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184027+0000", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184027+0000", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184027+0000", 2024-09-21T13:59:35.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184028+0000", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4270000000000001e-06 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184032+0000", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3550000000000001e-06 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184035+0000", 2024-09-21T13:59:35.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9919999999999999e-06 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185504 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195844+0000", 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0040103639999999998, 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013385988, 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185504 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195844+0000", 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195844+0000", 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195844+0000", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195846+0000", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3549999999999999e-06 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195853+0000", 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4710000000000004e-06 2024-09-21T13:59:35.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195858+0000", 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.135e-06 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185211 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136386+0000", 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063468806000000003, 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072930691000000006, 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185211 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136386+0000", 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136386+0000", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136386+0000", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136387+0000", 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.637e-06 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136391+0000", 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.89e-06 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136395+0000", 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3589999999999999e-06 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185243 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.137029+0000", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062825827000000001, 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072368778999999994, 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185243 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137029+0000", 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137029+0000", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137028+0000", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137031+0000", 2024-09-21T13:59:35.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.711e-06 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137039+0000", 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3810000000000001e-06 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137045+0000", 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0759999999999999e-06 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185326 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.151971+0000", 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047884098999999999, 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057512267999999998, 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185326 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.151971+0000", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.151971+0000", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.148091+0000", 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9961205 2024-09-21T13:59:35.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.151976+0000", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038845379999999999 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.151991+0000", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.518e-05 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152000+0000", 2024-09-21T13:59:35.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8599999999999999e-06 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185359 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160261+0000", 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039593847000000001, 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049321205999999999, 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185359 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160261+0000", 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160261+0000", 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160260+0000", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160263+0000", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3199999999999998e-06 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160269+0000", 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4919999999999998e-06 2024-09-21T13:59:35.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160275+0000", 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3419999999999998e-06 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185390 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172051+0000", 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027803914999999998, 2024-09-21T13:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037614834, 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185390 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172051+0000", 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172051+0000", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172050+0000", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172052+0000", 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6670000000000001e-06 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172056+0000", 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6049999999999998e-06 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172059+0000", 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9639999999999999e-06 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185422 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.184037+0000", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.015817716999999999, 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025707893999999998, 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185422 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184037+0000", 2024-09-21T13:59:35.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184037+0000", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184037+0000", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184038+0000", 2024-09-21T13:59:35.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6270000000000001e-06 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184042+0000", 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.27e-06 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184045+0000", 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0680000000000001e-06 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185505 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195863+0000", 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039913370000000002, 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013964084, 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185505 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195863+0000", 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195863+0000", 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195863+0000", 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195865+0000", 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.458e-06 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195872+0000", 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3589999999999996e-06 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195877+0000", 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2100000000000001e-06 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185212 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136397+0000", 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063457432999999994, 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073511928000000004, 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.616 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185212 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136397+0000", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136397+0000", 2024-09-21T13:59:35.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136397+0000", 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136399+0000", 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6139999999999999e-06 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136402+0000", 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.771e-06 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136406+0000", 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3299999999999999e-06 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185244 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.137049+0000", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062805564999999994, 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939450000000003, 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185244 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137049+0000", 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137049+0000", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137049+0000", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137051+0000", 2024-09-21T13:59:35.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.605e-06 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137058+0000", 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1359999999999999e-06 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137064+0000", 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8780000000000003e-06 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185327 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152008+0000", 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047847011000000002, 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.058067055999999999, 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185327 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152008+0000", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152008+0000", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152007+0000", 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152016+0000", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2969999999999992e-06 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152026+0000", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4720000000000001e-06 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152032+0000", 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0310000000000004e-06 2024-09-21T13:59:35.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185360 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160279+0000", 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039575272000000002, 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049875141999999997, 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185360 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160279+0000", 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160279+0000", 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160279+0000", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160281+0000", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3130000000000001e-06 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160288+0000", 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160293+0000", 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1320000000000002e-06 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185391 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172061+0000", 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027793729999999999, 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038177080000000002, 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185391 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172061+0000", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172061+0000", 2024-09-21T13:59:35.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172061+0000", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172062+0000", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6220000000000001e-06 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172066+0000", 2024-09-21T13:59:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3919999999999999e-06 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172069+0000", 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9179999999999998e-06 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185423 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.184048+0000", 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01580722, 2024-09-21T13:59:35.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026268651000000001, 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185423 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184048+0000", 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184048+0000", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184047+0000", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184049+0000", 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2860000000000001e-06 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184052+0000", 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3589999999999999e-06 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184055+0000", 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8320000000000002e-06 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185506 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195881+0000", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039733729999999997, 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014517201, 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185506 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195881+0000", 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195881+0000", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195881+0000", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195883+0000", 2024-09-21T13:59:35.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5160000000000001e-06 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195891+0000", 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0190000000000006e-06 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195896+0000", 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0180000000000001e-06 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185213 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136409+0000", 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063446108000000001, 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074076296, 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185213 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136409+0000", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136409+0000", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136408+0000", 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136411+0000", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.401e-06 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136417+0000", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6660000000000002e-06 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136424+0000", 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6549999999999998e-06 2024-09-21T13:59:35.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185245 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.137118+0000", 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.062737188999999999, 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073450297999999997, 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185245 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137118+0000", 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137118+0000", 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137117+0000", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137120+0000", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.593e-06 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137126+0000", 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7020000000000004e-06 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137131+0000", 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1269999999999996e-06 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185328 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152037+0000", 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047817239999999997, 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.05861011, 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185328 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152037+0000", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152037+0000", 2024-09-21T13:59:35.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152037+0000", 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152040+0000", 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7800000000000001e-06 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152047+0000", 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0820000000000001e-06 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152052+0000", 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7929999999999997e-06 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185361 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160298+0000", 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039556860999999999, 2024-09-21T13:59:35.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050432790999999998, 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185361 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160298+0000", 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160298+0000", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160297+0000", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160300+0000", 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.232e-06 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160306+0000", 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4289999999999998e-06 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160311+0000", 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8879999999999996e-06 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185392 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172071+0000", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027783735, 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038738308999999999, 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185392 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172071+0000", 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172071+0000", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172071+0000", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172072+0000", 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6980000000000001e-06 2024-09-21T13:59:35.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172076+0000", 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3349999999999998e-06 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172079+0000", 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185424 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187789+0000", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.012065940000000001, 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023099597999999999, 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185424 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187789+0000", 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187789+0000", 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.184057+0000", 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9962683 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187793+0000", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037361690000000001 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187804+0000", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0604e-05 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187813+0000", 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1779999999999992e-06 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185507 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195901+0000", 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039536650000000003, 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015070597, 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185507 2024-09-21T13:59:35.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195901+0000", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195901+0000", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195901+0000", 2024-09-21T13:59:35.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195903+0000", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3800000000000001e-06 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195909+0000", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2670000000000003e-06 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195914+0000", 2024-09-21T13:59:35.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0880000000000002e-06 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185214 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136429+0000", 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063425352000000004, 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074623698000000002, 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.661 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185214 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136429+0000", 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136429+0000", 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136429+0000", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136431+0000", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2060000000000001e-06 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136435+0000", 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3980000000000001e-06 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136439+0000", 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185246 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.137901+0000", 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.061953557999999999, 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073238897999999997, 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185246 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137901+0000", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137901+0000", 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137133+0000", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9992323 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137906+0000", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077257300000000003 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137918+0000", 2024-09-21T13:59:35.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1605e-05 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137925+0000", 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8019999999999992e-06 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185330 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152057+0000", 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047797979999999997, 2024-09-21T13:59:35.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059163961000000001, 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185330 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152057+0000", 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152057+0000", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152056+0000", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152059+0000", 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2589999999999999e-06 2024-09-21T13:59:35.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152065+0000", 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7479999999999996e-06 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152071+0000", 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7989999999999999e-06 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185362 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160315+0000", 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039539287999999999, 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050988906000000001, 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185362 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160315+0000", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160315+0000", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160315+0000", 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160317+0000", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0880000000000002e-06 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160324+0000", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3550000000000001e-06 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160328+0000", 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9130000000000002e-06 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185393 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172081+0000", 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027773454, 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.039302385000000002, 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185393 2024-09-21T13:59:35.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172081+0000", 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172081+0000", 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172081+0000", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172082+0000", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.393e-06 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172086+0000", 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5159999999999999e-06 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172089+0000", 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7779999999999999e-06 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185425 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187822+0000", 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.012032275, 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023642847000000002, 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185425 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187822+0000", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187822+0000", 2024-09-21T13:59:35.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187822+0000", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187830+0000", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2069999999999995e-06 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187837+0000", 2024-09-21T13:59:35.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4030000000000001e-06 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187843+0000", 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5990000000000001e-06 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185508 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195919+0000", 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039361200000000004, 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015629746, 2024-09-21T13:59:35.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185508 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195919+0000", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195919+0000", 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195918+0000", 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195921+0000", 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5359999999999999e-06 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195927+0000", 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2960000000000004e-06 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195932+0000", 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8890000000000001e-06 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185215 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136444+0000", 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063411131999999995, 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.075468311999999996, 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185215 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136444+0000", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136444+0000", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136443+0000", 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136445+0000", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8610000000000001e-06 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136449+0000", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8589999999999998e-06 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136456+0000", 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2119999999999997e-06 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185247 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.138046+0000", 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.061808489000000001, 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073946739999999997, 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.687 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185247 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138046+0000", 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138046+0000", 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.137932+0000", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9998856 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138050+0000", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118453 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138059+0000", 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4659999999999999e-06 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138064+0000", 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0509999999999996e-06 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185331 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152076+0000", 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047779171000000002, 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.060001993000000003, 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185331 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152076+0000", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152076+0000", 2024-09-21T13:59:35.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152075+0000", 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152077+0000", 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2189999999999998e-06 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152086+0000", 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152092+0000", 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6189999999999996e-06 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185363 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.160346+0000", 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.039508869000000002, 2024-09-21T13:59:35.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051811308, 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185363 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160346+0000", 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160346+0000", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160346+0000", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160348+0000", 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.125e-06 2024-09-21T13:59:35.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160352+0000", 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2359999999999998e-06 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160355+0000", 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2119999999999999e-06 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185394 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172092+0000", 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027762967, 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040150679000000002, 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185394 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172092+0000", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172092+0000", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172092+0000", 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172093+0000", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.387e-06 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172097+0000", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0659999999999997e-06 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172100+0000", 2024-09-21T13:59:35.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.101e-06 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185477 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187848+0000", 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.012006341, 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024472563999999999, 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.700 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185477 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187848+0000", 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187848+0000", 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187848+0000", 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187850+0000", 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187857+0000", 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3470000000000004e-06 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187862+0000", 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4190000000000001e-06 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185509 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195937+0000", 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039181210000000001, 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016463604999999999, 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185509 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195937+0000", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195937+0000", 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195936+0000", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195939+0000", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.368e-06 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195945+0000", 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3239999999999999e-06 2024-09-21T13:59:35.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195950+0000", 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185216 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136462+0000", 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063392298, 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076022619, 2024-09-21T13:59:35.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185216 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136462+0000", 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136462+0000", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136462+0000", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136464+0000", 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136468+0000", 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3710000000000002e-06 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136472+0000", 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3450000000000002e-06 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185248 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.138777+0000", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.061077662999999997, 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073789970999999996, 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185248 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138777+0000", 2024-09-21T13:59:35.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138777+0000", 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138092+0000", 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9993153 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138782+0000", 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068922899999999997 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138792+0000", 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.012e-05 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138799+0000", 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6599999999999995e-06 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185332 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152097+0000", 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047757603000000003, 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.060555098000000002, 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185332 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152097+0000", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152097+0000", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152097+0000", 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152099+0000", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6079999999999998e-06 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152106+0000", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152111+0000", 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0669999999999999e-06 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185364 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164096+0000", 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035759063000000001, 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.048635892999999999, 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185364 2024-09-21T13:59:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164096+0000", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164096+0000", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.160375+0000", 2024-09-21T13:59:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9962797 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164100+0000", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037251110000000001 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164114+0000", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3674e-05 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164120+0000", 2024-09-21T13:59:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5720000000000002e-06 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185395 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.172103+0000", 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027752004, 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040711904, 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185395 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172103+0000", 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172103+0000", 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172102+0000", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172104+0000", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7659999999999999e-06 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172108+0000", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4000000000000001e-06 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172111+0000", 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.163e-06 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185478 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187869+0000", 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011986131000000001, 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025025757999999999, 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185478 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187869+0000", 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187869+0000", 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187868+0000", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187871+0000", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5170000000000002e-06 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187877+0000", 2024-09-21T13:59:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.601e-06 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187883+0000", 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5709999999999997e-06 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185510 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195954+0000", 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039003309999999999, 2024-09-21T13:59:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017023337999999999, 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185510 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195954+0000", 2024-09-21T13:59:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195954+0000", 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195954+0000", 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195956+0000", 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2670000000000001e-06 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195962+0000", 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7479999999999999e-06 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195967+0000", 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0359999999999997e-06 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185217 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136476+0000", 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.06337922, 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.076583867999999999, 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185217 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136476+0000", 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136476+0000", 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136475+0000", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136477+0000", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.531e-06 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136481+0000", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7969999999999998e-06 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136484+0000", 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3890000000000001e-06 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185249 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.138923+0000", 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.060931827000000001, 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074219938999999999, 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185249 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138923+0000", 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138923+0000", 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138808+0000", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9998846 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138927+0000", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119677 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138937+0000", 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3619999999999995e-06 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138944+0000", 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6149999999999999e-06 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185333 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152115+0000", 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047739239000000003, 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.061107271999999997, 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185333 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152115+0000", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152115+0000", 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152115+0000", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152118+0000", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.441e-06 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152124+0000", 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3180000000000003e-06 2024-09-21T13:59:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152131+0000", 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2869999999999999e-06 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185365 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164152+0000", 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0357028, 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049150172999999998, 2024-09-21T13:59:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185365 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164152+0000", 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164152+0000", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164151+0000", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164155+0000", 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5999999999999998e-06 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164162+0000", 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4970000000000004e-06 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164168+0000", 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8470000000000001e-06 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185396 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175689+0000", 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024165836, 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037696237, 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185396 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175689+0000", 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175689+0000", 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.172113+0000", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9964242 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175693+0000", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035796920000000002 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175700+0000", 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5290000000000003e-06 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175705+0000", 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2989999999999998e-06 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185479 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187887+0000", 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011967289000000001, 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025577127000000002, 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185479 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187887+0000", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187887+0000", 2024-09-21T13:59:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187887+0000", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187889+0000", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.419e-06 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187896+0000", 2024-09-21T13:59:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187901+0000", 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3329999999999996e-06 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185511 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.195985+0000", 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003869857, 2024-09-21T13:59:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017565911999999999, 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185511 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195985+0000", 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195985+0000", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195985+0000", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195987+0000", 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0059999999999999e-06 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195991+0000", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1320000000000004e-06 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.195994+0000", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0580000000000002e-06 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185218 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136487+0000", 2024-09-21T13:59:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063367842999999993, 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.077145704999999995, 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185218 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136487+0000", 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136487+0000", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136487+0000", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136488+0000", 2024-09-21T13:59:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7630000000000001e-06 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136492+0000", 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7160000000000001e-06 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136497+0000", 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.395e-06 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185250 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.139125+0000", 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.060729665000000002, 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074593771000000003, 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185250 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139125+0000", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139125+0000", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.138950+0000", 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9998255 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139130+0000", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018011700000000001 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139140+0000", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7219999999999994e-06 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139147+0000", 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.233e-06 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185334 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152136+0000", 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.04771885, 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.061663032999999999, 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185334 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152136+0000", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152136+0000", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152135+0000", 2024-09-21T13:59:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152139+0000", 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0299999999999998e-06 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152145+0000", 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152150+0000", 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4319999999999998e-06 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185366 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164173+0000", 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035681227000000003, 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049708448000000002, 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185366 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164173+0000", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164173+0000", 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164173+0000", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164176+0000", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3589999999999999e-06 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164183+0000", 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0079999999999996e-06 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164188+0000", 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0520000000000001e-06 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185397 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175750+0000", 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024104602999999999, 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038211400999999999, 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185397 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175750+0000", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175750+0000", 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175750+0000", 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175752+0000", 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.063e-06 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175756+0000", 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2220000000000004e-06 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175759+0000", 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.23e-06 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185480 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187906+0000", 2024-09-21T13:59:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011949154, 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026138442000000001, 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185480 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187906+0000", 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187906+0000", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187905+0000", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187908+0000", 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4789999999999999e-06 2024-09-21T13:59:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187914+0000", 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2899999999999999e-06 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187920+0000", 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4629999999999998e-06 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185512 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.196012+0000", 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0038424119999999999, 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018111444000000001, 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185512 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196012+0000", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196012+0000", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196012+0000", 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196014+0000", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4670000000000001e-06 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196017+0000", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9310000000000001e-06 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196021+0000", 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185219 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 14639104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.136502+0000", 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.063352451000000004, 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.077706511000000006, 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185219 2024-09-21T13:59:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136502+0000", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136502+0000", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136502+0000", 2024-09-21T13:59:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136504+0000", 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136508+0000", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3229999999999999e-06 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.136511+0000", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3730000000000001e-06 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.213852+0000", 2024-09-21T13:59:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.077340418999999994 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.214008+0000", 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015581500000000001 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.214209+0000", 2024-09-21T13:59:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020117299999999999 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185251 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.139347+0000", 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.060507944000000001, 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074982678999999997, 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185251 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139347+0000", 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139347+0000", 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139154+0000", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9998074 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139350+0000", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019645700000000001 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139365+0000", 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4428e-05 2024-09-21T13:59:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139371+0000", 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.117e-06 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185335 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152155+0000", 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047699877000000002, 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062258059999999997, 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185335 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152155+0000", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152155+0000", 2024-09-21T13:59:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152154+0000", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152157+0000", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4760000000000001e-06 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152163+0000", 2024-09-21T13:59:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3439999999999997e-06 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152168+0000", 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8949999999999997e-06 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185367 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164193+0000", 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035661327, 2024-09-21T13:59:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050307682999999999, 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185367 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164193+0000", 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164193+0000", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164193+0000", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164195+0000", 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.61e-06 2024-09-21T13:59:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164202+0000", 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4869999999999999e-06 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164208+0000", 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7509999999999997e-06 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185398 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175762+0000", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024093026999999999, 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038822924000000002, 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185398 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175762+0000", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175762+0000", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175761+0000", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175764+0000", 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.074e-06 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175767+0000", 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.563e-06 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175770+0000", 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1310000000000002e-06 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185481 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187925+0000", 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011929492, 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026737962000000001, 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185481 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187925+0000", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187925+0000", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187925+0000", 2024-09-21T13:59:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187928+0000", 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6879999999999999e-06 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187934+0000", 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4069999999999998e-06 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187939+0000", 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4790000000000004e-06 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185513 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200002+0000", 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998527, 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014742363, 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185513 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200002+0000", 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200002+0000", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.196024+0000", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9960217 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200011+0000", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039867139999999997 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200022+0000", 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1511999999999999e-05 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200030+0000", 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.554e-06 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185252 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143722+0000", 2024-09-21T13:59:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056132969999999997, 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071109101999999993, 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185252 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143722+0000", 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143722+0000", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.139393+0000", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9956713 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143732+0000", 2024-09-21T13:59:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043391209999999996 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143742+0000", 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.781e-06 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143748+0000", 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4999999999999996e-06 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185336 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152173+0000", 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047681646000000001, 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062737438000000006, 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185336 2024-09-21T13:59:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152173+0000", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152173+0000", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152173+0000", 2024-09-21T13:59:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152175+0000", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.542e-06 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152182+0000", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5459999999999997e-06 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152187+0000", 2024-09-21T13:59:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5949999999999998e-06 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185368 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164212+0000", 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035642632, 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050789855000000002, 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185368 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164212+0000", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164212+0000", 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164212+0000", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164214+0000", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4499999999999998e-06 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164221+0000", 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6590000000000001e-06 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164226+0000", 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9710000000000003e-06 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185399 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175772+0000", 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024082240000000001, 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.039308812999999998, 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185399 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175772+0000", 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175772+0000", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175772+0000", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175774+0000", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3599999999999999e-06 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175777+0000", 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3859999999999999e-06 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175780+0000", 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2140000000000001e-06 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185482 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187944+0000", 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.01191067, 2024-09-21T13:59:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027220022999999999, 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185482 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187944+0000", 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187944+0000", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187944+0000", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187946+0000", 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4540000000000001e-06 2024-09-21T13:59:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187952+0000", 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3330000000000002e-06 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187958+0000", 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185514 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200038+0000", 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998164, 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015206912, 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185514 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200038+0000", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200038+0000", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200037+0000", 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200040+0000", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0369999999999999e-06 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200047+0000", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200053+0000", 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5450000000000003e-06 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185253 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143754+0000", 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056100724999999997, 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071576326999999995, 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185253 2024-09-21T13:59:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143754+0000", 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143754+0000", 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143754+0000", 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143756+0000", 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3029999999999998e-06 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143760+0000", 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4769999999999997e-06 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143764+0000", 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6169999999999998e-06 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185337 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152192+0000", 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047662665999999999, 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063221820999999997, 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185337 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152192+0000", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152192+0000", 2024-09-21T13:59:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152192+0000", 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152194+0000", 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4119999999999999e-06 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152201+0000", 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4790000000000001e-06 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152206+0000", 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9910000000000002e-06 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185369 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164230+0000", 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035624435000000003, 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051268743999999998, 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185369 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164230+0000", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164230+0000", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164230+0000", 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164232+0000", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6019999999999998e-06 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164239+0000", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5130000000000002e-06 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164244+0000", 2024-09-21T13:59:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2630000000000003e-06 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185400 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175783+0000", 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024072130000000001, 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.039795918999999999, 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185400 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175783+0000", 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175783+0000", 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175782+0000", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175784+0000", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.658e-06 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175787+0000", 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4259999999999999e-06 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175790+0000", 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0359999999999998e-06 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185483 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187962+0000", 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011892562000000001, 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027721394999999999, 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185483 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187962+0000", 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187962+0000", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187962+0000", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187964+0000", 2024-09-21T13:59:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5189999999999999e-06 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187970+0000", 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1619999999999996e-06 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187976+0000", 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2179999999999998e-06 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185515 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200058+0000", 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997973, 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015707599999999999, 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185515 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200058+0000", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200058+0000", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200057+0000", 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200060+0000", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.869e-06 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200067+0000", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7070000000000003e-06 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200072+0000", 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.169e-06 2024-09-21T13:59:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185254 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143767+0000", 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056087563999999999, 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072080333999999996, 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185254 2024-09-21T13:59:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143767+0000", 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143767+0000", 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143767+0000", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143769+0000", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.671e-06 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143772+0000", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9509999999999999e-06 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143776+0000", 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1930000000000002e-06 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185338 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152210+0000", 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047644956000000002, 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063722006999999997, 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185338 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152210+0000", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152210+0000", 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152209+0000", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152212+0000", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3209999999999999e-06 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152220+0000", 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0050000000000004e-06 2024-09-21T13:59:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152225+0000", 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185370 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164249+0000", 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035606132999999998, 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.051764481000000001, 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185370 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164249+0000", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164249+0000", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164248+0000", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164251+0000", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4339999999999999e-06 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164257+0000", 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4200000000000004e-06 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164262+0000", 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.417e-06 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185401 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175793+0000", 2024-09-21T13:59:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024061974999999999, 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040303074000000001, 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185401 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175793+0000", 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175793+0000", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175793+0000", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175800+0000", 2024-09-21T13:59:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9049999999999997e-06 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175804+0000", 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5729999999999999e-06 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175807+0000", 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0479999999999999e-06 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185484 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187980+0000", 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011874429000000001, 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028195152000000001, 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185484 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187980+0000", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187980+0000", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187980+0000", 2024-09-21T13:59:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187982+0000", 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4099999999999998e-06 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187989+0000", 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5139999999999998e-06 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187994+0000", 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3739999999999997e-06 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185516 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200076+0000", 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997783, 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016183520999999999, 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185516 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200076+0000", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200076+0000", 2024-09-21T13:59:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200076+0000", 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200079+0000", 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7020000000000001e-06 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200086+0000", 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7599999999999997e-06 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200091+0000", 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.327e-06 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185255 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143779+0000", 2024-09-21T13:59:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056075973000000001, 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072563214000000001, 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185255 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143779+0000", 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143779+0000", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143778+0000", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143780+0000", 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.688e-06 2024-09-21T13:59:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143784+0000", 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9770000000000002e-06 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143788+0000", 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3869999999999999e-06 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185339 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.152230+0000", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.047624646, 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.064195134000000001, 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185339 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152230+0000", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152230+0000", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152230+0000", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152232+0000", 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5490000000000001e-06 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152239+0000", 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4169999999999997e-06 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152244+0000", 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0370000000000002e-06 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185371 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164267+0000", 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035588061999999997, 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052238439999999997, 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185371 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164267+0000", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164267+0000", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164266+0000", 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164269+0000", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.503e-06 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164275+0000", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4579999999999998e-06 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164280+0000", 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0810000000000001e-06 2024-09-21T13:59:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185402 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175810+0000", 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024045057000000002, 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.040780202000000002, 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185402 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175810+0000", 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175810+0000", 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175809+0000", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175811+0000", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.446e-06 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175814+0000", 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.484e-06 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175817+0000", 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0489999999999999e-06 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185485 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.187999+0000", 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011855799, 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028671042000000001, 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185485 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187999+0000", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187999+0000", 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.187999+0000", 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.188001+0000", 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4439999999999998e-06 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.188007+0000", 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.188013+0000", 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1580000000000004e-06 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185517 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200095+0000", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997597, 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016665583000000001, 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185517 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200095+0000", 2024-09-21T13:59:35.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200095+0000", 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200095+0000", 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200097+0000", 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4090000000000001e-06 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200106+0000", 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6300000000000004e-06 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200111+0000", 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4530000000000001e-06 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185256 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143790+0000", 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056064230999999999, 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073054641000000003, 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185256 2024-09-21T13:59:35.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143790+0000", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143790+0000", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143790+0000", 2024-09-21T13:59:35.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143792+0000", 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.812e-06 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143796+0000", 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7780000000000001e-06 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143799+0000", 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.332e-06 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185340 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156009+0000", 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043845803000000003, 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.060915557000000002, 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185340 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156009+0000", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156009+0000", 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.152275+0000", 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9962659 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156017+0000", 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003742015 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156028+0000", 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0739e-05 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156036+0000", 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2660000000000001e-06 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185372 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164285+0000", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035569837999999999, 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.052723229000000003, 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185372 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164285+0000", 2024-09-21T13:59:35.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164285+0000", 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164285+0000", 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164287+0000", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164293+0000", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3060000000000003e-06 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164298+0000", 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.305e-06 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185403 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175820+0000", 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024035081999999999, 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041267616999999999, 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185403 2024-09-21T13:59:35.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175820+0000", 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175820+0000", 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175819+0000", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175821+0000", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5290000000000001e-06 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175824+0000", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3670000000000001e-06 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175827+0000", 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1080000000000001e-06 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185486 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191727+0000", 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0081272340000000005, 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025442376999999999, 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185486 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191727+0000", 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191727+0000", 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.188016+0000", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9962888 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191733+0000", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037164099999999999 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191742+0000", 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1759999999999999e-06 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191748+0000", 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3579999999999999e-06 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185518 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200116+0000", 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997387, 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017134772, 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185518 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200116+0000", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200116+0000", 2024-09-21T13:59:35.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200115+0000", 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200118+0000", 2024-09-21T13:59:35.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3910000000000001e-06 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200125+0000", 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6869999999999997e-06 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200130+0000", 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3410000000000002e-06 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185257 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143802+0000", 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056052882999999998, 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073534260000000004, 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185257 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143802+0000", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143802+0000", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143802+0000", 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143803+0000", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143807+0000", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7400000000000002e-06 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143810+0000", 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4199999999999999e-06 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.900 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185341 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156044+0000", 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043810676, 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.061371514000000002, 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185341 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.901 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156044+0000", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156044+0000", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156043+0000", 2024-09-21T13:59:35.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156047+0000", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.512e-06 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156054+0000", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6869999999999997e-06 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156059+0000", 2024-09-21T13:59:35.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6019999999999999e-06 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185373 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164303+0000", 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.03555183, 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053198715000000001, 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185373 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164303+0000", 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164303+0000", 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164302+0000", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164305+0000", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4650000000000001e-06 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164311+0000", 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3940000000000001e-06 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164317+0000", 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.366e-06 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185404 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.175830+0000", 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.024024831, 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041751259999999998, 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185404 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175830+0000", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175830+0000", 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175830+0000", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175831+0000", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.39e-06 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175834+0000", 2024-09-21T13:59:35.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2990000000000001e-06 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175837+0000", 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.96e-06 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185487 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191772+0000", 2024-09-21T13:59:35.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080824910000000007, 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025894853999999998, 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185487 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191772+0000", 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191772+0000", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191772+0000", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191774+0000", 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3120000000000001e-06 2024-09-21T13:59:35.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191782+0000", 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6860000000000006e-06 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191785+0000", 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4580000000000002e-06 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185519 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200134+0000", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997206, 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017614250000000001, 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185519 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200134+0000", 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200134+0000", 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200134+0000", 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200136+0000", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.452e-06 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200143+0000", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999997e-06 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200148+0000", 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3079999999999998e-06 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185258 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.143813+0000", 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.056041555999999999, 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074020766000000002, 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185258 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143813+0000", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143813+0000", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143813+0000", 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143815+0000", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7370000000000001e-06 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143818+0000", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7100000000000001e-06 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.143822+0000", 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3349999999999998e-06 2024-09-21T13:59:35.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185342 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.156064+0000", 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.043790754000000001, 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.061854464999999997, 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185342 2024-09-21T13:59:35.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156064+0000", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156064+0000", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156063+0000", 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156066+0000", 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156073+0000", 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6800000000000004e-06 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.156078+0000", 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0250000000000002e-06 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185374 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.164321+0000", 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.035533649, 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053676586999999998, 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185374 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164321+0000", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164321+0000", 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164321+0000", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164323+0000", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3889999999999999e-06 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164331+0000", 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1950000000000003e-06 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.164336+0000", 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9019999999999998e-06 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185405 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.179863+0000", 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.019991469000000001, 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.038221468000000001, 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.926 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185405 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179863+0000", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179863+0000", 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.175839+0000", 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.995976 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179868+0000", 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004028434 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179877+0000", 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4399999999999994e-06 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.179883+0000", 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3310000000000003e-06 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185488 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.191788+0000", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080665660000000007, 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026376047999999999, 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185488 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191788+0000", 2024-09-21T13:59:35.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191788+0000", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191788+0000", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191795+0000", 2024-09-21T13:59:35.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4209999999999998e-06 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191799+0000", 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8909999999999997e-06 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.191802+0000", 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.954e-06 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:185520 3.e 3.c28d98ce (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:35.200152+0000", 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997025, 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018096461000000001, 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 185520 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:35.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200152+0000", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200152+0000", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200152+0000", 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200154+0000", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3829999999999999e-06 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200161+0000", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5019999999999998e-06 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.200166+0000", 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.904e-06 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:35.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:35.936 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T13:59:35.936 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 216 2024-09-21T13:59:35.936 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:35.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:35.938 INFO:teuthology.orchestra.run.smithi079.stdout:3674 write 0xb960979 thru 0xb962583 (0x1c0b bytes) 2024-09-21T13:59:35.938 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:35.938 INFO:teuthology.orchestra.run.smithi079.stdout:3676 write 0xc4a62df thru 0xc4b08f4 (0xa616 bytes) 2024-09-21T13:59:35.938 INFO:teuthology.orchestra.run.smithi079.stdout:3677 writesame 0x4081813 thru 0x408d841 data_size 0x1(0xc02f bytes) 2024-09-21T13:59:35.938 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:59:35.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:35.940 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.1. 2024-09-21T13:59:35.940 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-21T13:59:35.941 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:35.941 INFO:teuthology.orchestra.run.smithi079.stdout:3679 read 0x31e9c14 thru 0x31ea90f (0xcfc bytes) 2024-09-21T13:59:35.941 INFO:teuthology.orchestra.run.smithi079.stdout:3680 punch from 0x67beabd to 0x67c72d8, (0x881b bytes) 2024-09-21T13:59:35.941 INFO:teuthology.orchestra.run.smithi079.stdout:3681 write 0x42962cb thru 0x429c28d (0x5fc3 bytes) 2024-09-21T13:59:35.941 INFO:teuthology.orchestra.run.smithi079.stdout:3682 trunc from 0xedc173b to 0x937f04e 2024-09-21T13:59:35.942 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:35.936+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:36.039 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:36.036+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:36.071 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:36.072 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:36.072 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:36.072 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:36.072 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:36.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:36.139 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:36.139 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:36.139 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:36.140+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:36.156 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:36.156 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:36.172 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:36.172 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:36.187 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:36.188 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:36.205 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:36.206 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:36.225 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:36.226 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:36.240 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:36.236+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:36.245 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:36.245 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:36.246 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:36.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:36.251 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:36.252 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:36.252 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:36.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:36.355 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:36.352+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:36.439 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:36.439 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:36.442 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:36.440+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:36.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:36.542 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:36.540+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:36.620 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:36.620 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:36.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:36.643 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:36.644+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:36.744 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:36.740+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:36.757 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:36.758 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:36.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:36.859 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:36.856+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:36.941 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:36.941 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:36.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:36.944+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:36.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:37.046 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:37.040+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:37.122 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.122 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:37.179 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:37.176+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:37.247 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:37.244+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:37.296 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.296 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:37.359 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:37.356+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:37.441 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.442 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.449 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:37.448+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:37.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:37.550 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:37.548+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:37.626 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.626 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:37.650 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:37.644+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:37.703 INFO:teuthology.orchestra.run.smithi079.stdout:3683 write 0x5288841 thru 0x528db45 (0x5305 bytes) 2024-09-21T13:59:37.724 INFO:teuthology.orchestra.run.smithi079.stdout:3684 write 0xb2c55cf thru 0xb2c771e (0x2150 bytes) 2024-09-21T13:59:37.730 INFO:teuthology.orchestra.run.smithi079.stdout:3685 punch from 0x843e8ff to 0x843ef8f, (0x690 bytes) 2024-09-21T13:59:37.730 INFO:teuthology.orchestra.run.smithi079.stdout:3686 punch from 0x7c0c116 to 0x7c1bc95, (0xfb7f bytes) 2024-09-21T13:59:37.730 INFO:teuthology.orchestra.run.smithi079.stdout:3688 write 0xa3af93 thru 0xa49371 (0xe3df bytes) 2024-09-21T13:59:37.751 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:37.748+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:37.780 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.780 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:37.852 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:37.848+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:37.936 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:37.937 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:37.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:59:37.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:37.953 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:37.948+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:38.000 INFO:teuthology.orchestra.run.smithi079.stdout:3690 trunc from 0xb2c771f to 0x622b3f7 2024-09-21T13:59:38.021 INFO:teuthology.orchestra.run.smithi079.stdout:3691 punch from 0xb2eaab to 0xb3e604, (0xfb59 bytes) 2024-09-21T13:59:38.040 INFO:teuthology.orchestra.run.smithi079.stdout:3693 write 0xc8ee55c thru 0xc8fa9c2 (0xc467 bytes) 2024-09-21T13:59:38.050 INFO:teuthology.orchestra.run.smithi079.stdout:3695 read 0x15ee152 thru 0x15fda59 (0xf908 bytes) 2024-09-21T13:59:38.053 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:38.048+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:38.054 INFO:teuthology.orchestra.run.smithi079.stdout:3696 read 0x22a720a thru 0x22b5ef2 (0xece9 bytes) 2024-09-21T13:59:38.056 INFO:teuthology.orchestra.run.smithi079.stdout:3697 punch from 0x315d346 to 0x315e848, (0x1502 bytes) 2024-09-21T13:59:38.060 INFO:teuthology.orchestra.run.smithi079.stdout:3698 trunc from 0xc8fa9c3 to 0x9f5998a 2024-09-21T13:59:38.077 INFO:teuthology.orchestra.run.smithi079.stdout:3699 write 0x6cdac79 thru 0x6cea77c (0xfb04 bytes) 2024-09-21T13:59:38.087 INFO:teuthology.orchestra.run.smithi079.stdout:3701 punch from 0x48cd3db to 0x48ce2d4, (0xef9 bytes) 2024-09-21T13:59:38.088 INFO:teuthology.orchestra.run.smithi079.stdout:3702 read 0x6892426 thru 0x68a07b5 (0xe390 bytes) 2024-09-21T13:59:38.088 INFO:teuthology.orchestra.run.smithi079.stdout:3703 read 0x7e31cd5 thru 0x7e4096b (0xec97 bytes) 2024-09-21T13:59:38.102 INFO:teuthology.orchestra.run.smithi079.stdout:3705 write 0xc8cd059 thru 0xc8dcd7a (0xfd22 bytes) 2024-09-21T13:59:38.111 INFO:teuthology.orchestra.run.smithi079.stdout:3706 write 0x729732d thru 0x729a3ac (0x3080 bytes) 2024-09-21T13:59:38.126 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:38.127 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:38.131 INFO:teuthology.orchestra.run.smithi079.stdout:3707 writesame 0xe0e23ce thru 0xe0e37a6 data_size 0x1(0x13d9 bytes) 2024-09-21T13:59:38.131 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.133 INFO:teuthology.orchestra.run.smithi079.stdout:3709 trunc from 0xe0e37a7 to 0xca66d2b 2024-09-21T13:59:38.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:38.146 INFO:teuthology.orchestra.run.smithi079.stdout:3710 read 0x6329fe3 thru 0x632da50 (0x3a6e bytes) 2024-09-21T13:59:38.147 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.147 INFO:teuthology.orchestra.run.smithi079.stdout:3713 punch from 0x68c0807 to 0x68c59a0, (0x5199 bytes) 2024-09-21T13:59:38.147 INFO:teuthology.orchestra.run.smithi079.stdout:3714 read 0x9bdaa5d thru 0x9be8665 (0xdc09 bytes) 2024-09-21T13:59:38.147 INFO:teuthology.orchestra.run.smithi079.stdout:3715 read 0x1f2ae83 thru 0x1f38025 (0xd1a3 bytes) 2024-09-21T13:59:38.148 INFO:teuthology.orchestra.run.smithi079.stdout:3717 write 0x4bcd8bf thru 0x4bd1d72 (0x44b4 bytes) 2024-09-21T13:59:38.153 INFO:teuthology.orchestra.run.smithi079.stdout:3718 trunc from 0xca66d2b to 0xe0b6ad5 2024-09-21T13:59:38.153 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:38.152+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:38.162 INFO:teuthology.orchestra.run.smithi079.stdout:3719 writesame 0x1c83b97 thru 0x1c8e2b2 data_size 0x5c(0xa71c bytes) 2024-09-21T13:59:38.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:38.254 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:38.252+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:38.271 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:38.271 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:38.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:38.357 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:59:38.358 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:38.356+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:38.400 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:38.400 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:38.409 INFO:teuthology.orchestra.run.smithi079.stdout:3721 punch from 0x960ca67 to 0x9616cdd, (0xa276 bytes) 2024-09-21T13:59:38.409 INFO:teuthology.orchestra.run.smithi079.stdout:3722 write 0xfb521d thru 0xfbb6e2 (0x64c6 bytes) 2024-09-21T13:59:38.414 INFO:teuthology.orchestra.run.smithi079.stdout:3723 writesame 0x4cc21d thru 0x4d4072 data_size 0x67(0x7e56 bytes) 2024-09-21T13:59:38.418 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:38.419 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:38.446 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:38.446 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:38.455 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:38.456+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:38.466 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:38.469 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:38.469 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:38.470 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:38.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:38.495 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:38.495 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:38.516 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:38.517 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:38.537 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:38.537 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:38.538 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:38.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:38.542 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:38.584 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:38.584+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:38.590 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.590 INFO:teuthology.orchestra.run.smithi079.stdout:3726 writesame 0x184a4a thru 0x18d3a6 data_size 0xd(0x895d bytes) 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:3730 punch from 0x1cae886 to 0x1cbc609, (0xdd83 bytes) 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:3735 read 0xa7aeeb2 thru 0xa7af3a4 (0x4f3 bytes) 2024-09-21T13:59:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:3736 write 0xc62711b thru 0xc6329e0 (0xb8c6 bytes) 2024-09-21T13:59:38.601 INFO:teuthology.orchestra.run.smithi079.stdout:3737 read 0x122acd0 thru 0x12308d3 (0x5c04 bytes) 2024-09-21T13:59:38.602 INFO:teuthology.orchestra.run.smithi079.stdout:3738 punch from 0xbb3c521 to 0xbb41f11, (0x59f0 bytes) 2024-09-21T13:59:38.602 INFO:teuthology.orchestra.run.smithi079.stdout:3739 write 0x6c9901b thru 0x6ca2b37 (0x9b1d bytes) 2024-09-21T13:59:38.621 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:38.621 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:38.621 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:38.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:38.657 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:38.652+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:38.757 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:38.756+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:38.800 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279230046999999, 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:38.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279118424000004, 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:38.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279098601000001, 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:38.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:38.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:38.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279074422000001, 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:38.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279050316999999, 2024-09-21T13:59:38.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:38.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279031807999999, 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.830 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:38.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:38.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.279022066000003, 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:38.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278997207000003, 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:38.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.27896853, 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:38.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.848 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278949711999999, 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:38.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:38.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278929040999998, 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278907969999999, 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:38.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:38.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:38.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278872118000002, 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:38.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:38.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:38.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278839896000001, 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:38.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:38.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278804256000001, 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:38.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:38.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:38.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278769777999997, 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:38.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:38.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:38.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:38.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:38.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278715218000002, 2024-09-21T13:59:38.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:38.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:38.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:38.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278676052999998, 2024-09-21T13:59:38.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:38.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:38.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278637316999998, 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:38.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:38.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.278612563999999, 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:38.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:38.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:38.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.924 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:38.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:38.925 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:38.926 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:38.926 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:38.924+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:39.027 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:39.024+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:39.096 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:39.096 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:39.096 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:39.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:39.128 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:39.124+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:39.229 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:39.228+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:39.231 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:39.231 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:39.231 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:39.231 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:39.231 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:39.245 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:39.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:39.332+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:39.384 INFO:teuthology.orchestra.run.smithi079.stdout:3740 read 0x6e6742a thru 0x6e708bc (0x9493 bytes) 2024-09-21T13:59:39.385 INFO:teuthology.orchestra.run.smithi079.stdout:3741 read 0xc588170 thru 0xc58c4d8 (0x4369 bytes) 2024-09-21T13:59:39.389 INFO:teuthology.orchestra.run.smithi079.stdout:3742 read 0x34acf19 thru 0x34b308c (0x6174 bytes) 2024-09-21T13:59:39.391 INFO:teuthology.orchestra.run.smithi079.stdout:3743 write 0x5afa10d thru 0x5b09b74 (0xfa68 bytes) 2024-09-21T13:59:39.396 INFO:teuthology.orchestra.run.smithi079.stdout:3744 write 0x59776a5 thru 0x5980706 (0x9062 bytes) 2024-09-21T13:59:39.405 INFO:teuthology.orchestra.run.smithi079.stdout:3746 punch from 0xad2a3ce to 0xad367de, (0xc410 bytes) 2024-09-21T13:59:39.406 INFO:teuthology.orchestra.run.smithi079.stdout:3748 writesame 0x82a564f thru 0x82b3b2b data_size 0x1(0xe4dd bytes) 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.020735647000002, 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:39.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.980648809000002, 2024-09-21T13:59:39.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:39.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.919335553000003, 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133358 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 76800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611130858000003, 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058918719000000001, 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133358 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811181+0000", 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811185+0000", 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811193+0000", 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1289999999999996e-06 2024-09-21T13:59:39.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811200+0000", 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7129999999999999e-06 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869833+0000", 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058633115999999999 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869948+0000", 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115584 2024-09-21T13:59:39.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870101+0000", 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152287 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133359 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611107390000001, 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059286298000000001, 2024-09-21T13:59:39.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133359 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:39.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811205+0000", 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811208+0000", 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2729999999999998e-06 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811216+0000", 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.259e-06 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811223+0000", 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6259999999999997e-06 2024-09-21T13:59:39.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870168+0000", 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058945164000000001 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870311+0000", 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142464 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870492+0000", 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181118 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133360 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 87040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:39.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611084253999998, 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059596781000000001, 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133360 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811228+0000", 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811231+0000", 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.196e-06 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811239+0000", 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-09-21T13:59:39.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811246+0000", 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6100000000000002e-06 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870555+0000", 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059309029999999999 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870673+0000", 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118363 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870825+0000", 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015213600000000001 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133361 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 92160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611061413000002, 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059958546000000001, 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133361 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811254+0000", 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.337e-06 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811262+0000", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1659999999999994e-06 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811269+0000", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5930000000000002e-06 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870893+0000", 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059623968999999999 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871028+0000", 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135501 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871210+0000", 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018161699999999999 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.470 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133362 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 97280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611038080999997, 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060278945, 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133362 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811274+0000", 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811277+0000", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000001e-06 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811285+0000", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9119999999999998e-06 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811292+0000", 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6200000000000001e-06 2024-09-21T13:59:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871273+0000", 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059980588000000001 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871400+0000", 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127525 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871554+0000", 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015371300000000001 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133363 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 103424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.611000513999997, 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060623992000000002, 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133363 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811315+0000", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3529999999999999e-06 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811324+0000", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5089999999999993e-06 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811330+0000", 2024-09-21T13:59:39.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871620+0000", 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060289397000000002 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871753+0000", 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132908 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871936+0000", 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000183881 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133364 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610976952000001, 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060935982, 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133364 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811335+0000", 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811339+0000", 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2229999999999999e-06 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811347+0000", 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2730000000000002e-06 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811353+0000", 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5989999999999998e-06 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871999+0000", 2024-09-21T13:59:39.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060645731000000001 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872119+0000", 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119867 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872272+0000", 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015293199999999999 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133365 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 113664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610953727000002, 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.06130443, 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133365 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811362+0000", 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2160000000000002e-06 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811370+0000", 2024-09-21T13:59:39.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811376+0000", 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3799999999999999e-06 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872342+0000", 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060965424999999997 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872482+0000", 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014024400000000001 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872664+0000", 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018166499999999999 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133366 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 118784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610930797999998, 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061625971000000002, 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133366 2024-09-21T13:59:39.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:39.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811385+0000", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.332e-06 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811393+0000", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170000000000004e-06 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811400+0000", 2024-09-21T13:59:39.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6889999999999998e-06 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872726+0000", 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061325932999999999 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872856+0000", 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130588 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873008+0000", 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000151905 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133367 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 123904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610907599999997, 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061995883000000002, 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133367 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811408+0000", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.14e-06 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811416+0000", 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0490000000000004e-06 2024-09-21T13:59:39.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811422+0000", 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873082+0000", 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061659985 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873224+0000", 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014196400000000001 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873401+0000", 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017682099999999999 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133368 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 129024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610884884999997, 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062336753000000002, 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.500 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133368 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811427+0000", 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811454+0000", 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6825000000000002e-05 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811464+0000", 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5990000000000008e-06 2024-09-21T13:59:39.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811471+0000", 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873463+0000", 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061991549 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873609+0000", 2024-09-21T13:59:39.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014674999999999999 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873765+0000", 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155456 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133369 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 135168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610835651000002, 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062595426999999995, 2024-09-21T13:59:39.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133369 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.509 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811480+0000", 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.18e-06 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811488+0000", 2024-09-21T13:59:39.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811495+0000", 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.686e-06 2024-09-21T13:59:39.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873807+0000", 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062312233000000002 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873921+0000", 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113486 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874073+0000", 2024-09-21T13:59:39.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152156 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133370 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 140288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610812346000003, 2024-09-21T13:59:39.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063038644000000005, 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133370 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811500+0000", 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811503+0000", 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5020000000000001e-06 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811512+0000", 2024-09-21T13:59:39.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811518+0000", 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7660000000000001e-06 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874173+0000", 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062654177000000005 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874335+0000", 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016219499999999999 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874539+0000", 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133371 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 145408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610788958000001, 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0633967, 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.523 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133371 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:39.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811523+0000", 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811527+0000", 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811535+0000", 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811542+0000", 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874635+0000", 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063093623000000001 2024-09-21T13:59:39.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874762+0000", 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012691199999999999 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874921+0000", 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848899999999999 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133372 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 150528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610765639, 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063676675000000002, 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133372 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811550+0000", 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1889999999999999e-06 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811558+0000", 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1769999999999998e-06 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811565+0000", 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874963+0000", 2024-09-21T13:59:39.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063398191000000007 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875075+0000", 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011169499999999999 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875224+0000", 2024-09-21T13:59:39.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014938700000000001 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133373 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610740460999999, 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064102759999999995, 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133373 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811575+0000", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811583+0000", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4090000000000003e-06 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811590+0000", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0559999999999999e-06 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875318+0000", 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063727151999999995 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875477+0000", 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015933500000000001 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875675+0000", 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019835400000000001 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133374 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 160768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:39.538 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.610713769, 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064394145999999999, 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133374 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:39.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811598+0000", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:39.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811603+0000", 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2499999999999997e-06 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811619+0000", 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5736e-05 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811633+0000", 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3862e-05 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875721+0000", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064088110000000004 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875838+0000", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116801 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875993+0000", 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015558400000000001 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:39.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:39.543 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:39.544 INFO:teuthology.orchestra.run.smithi079.stdout:3749 punch from 0xd71a65b to 0xd720193, (0x5b38 bytes) 2024-09-21T13:59:39.544 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:39.544 INFO:teuthology.orchestra.run.smithi079.stdout:3758 punch from 0x75feaca to 0x76007fd, (0x1d33 bytes) 2024-09-21T13:59:39.544 INFO:teuthology.orchestra.run.smithi079.stdout:3759 write 0x5c320ce thru 0x5c3349c (0x13cf bytes) 2024-09-21T13:59:39.545 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:3760 writesame 0x9373b03 thru 0x93744dd data_size 0x3(0x9db bytes) 2024-09-21T13:59:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:3761 trunc from 0xe0b6ad5 to 0xcbc0caa 2024-09-21T13:59:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:3762 punch from 0x77955b8 to 0x7795fae, (0x9f6 bytes) 2024-09-21T13:59:39.546 INFO:teuthology.orchestra.run.smithi079.stdout:3764 flatten 2024-09-21T13:59:39.546 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:39.540+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:39.645 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:39.644+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:39.689 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:39.689 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:39.689 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:39.690 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:39.703 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:39.751 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:39.748+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:39.829 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:39.829 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:39.829 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:39.829 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:39.829 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:39.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:3770 write 0xb386276 thru 0xb394f43 (0xecce bytes) 2024-09-21T13:59:39.878 INFO:teuthology.orchestra.run.smithi079.stdout:3771 read 0x411093 thru 0x41859d (0x750b bytes) 2024-09-21T13:59:39.880 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:39.887 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:39.884+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:39.902 INFO:teuthology.orchestra.run.smithi079.stdout:3773 trunc from 0xcbc0caa to 0x47375c0 2024-09-21T13:59:39.949 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:39.944+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:39.949 INFO:teuthology.orchestra.run.smithi079.stdout:3774 write 0x5382b98 thru 0x538dd40 (0xb1a9 bytes) 2024-09-21T13:59:39.972 INFO:teuthology.orchestra.run.smithi079.stdout:3779 trunc from 0x538dd41 to 0x17c823a 2024-09-21T13:59:40.006 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.006 INFO:teuthology.orchestra.run.smithi079.stdout:3781 read 0x59db68 thru 0x5a6adb (0x8f74 bytes) 2024-09-21T13:59:40.022 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184280 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1306385929999996, 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090236616000000006, 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184280 2024-09-21T13:59:40.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:40.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888578+0000", 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2200000000000001e-06 2024-09-21T13:59:40.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888587+0000", 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5429999999999994e-06 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888594+0000", 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2729999999999997e-06 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978789+0000", 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090195136999999995 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978812+0000", 2024-09-21T13:59:40.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3057e-05 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184281 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1305811390000002, 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090219523999999995, 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184281 2024-09-21T13:59:40.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888632+0000", 2024-09-21T13:59:40.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888644+0000", 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1962e-05 2024-09-21T13:59:40.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888656+0000", 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.184e-05 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888663+0000", 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1400000000000002e-06 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978840+0000", 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090176651999999996 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978852+0000", 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2839e-05 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184282 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:40.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1305437439999997, 2024-09-21T13:59:40.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090241523000000004, 2024-09-21T13:59:40.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184282 2024-09-21T13:59:40.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888669+0000", 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888673+0000", 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6059999999999999e-06 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888681+0000", 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888688+0000", 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.99e-06 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978889+0000", 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090201105000000004 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978912+0000", 2024-09-21T13:59:40.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2308000000000001e-05 2024-09-21T13:59:40.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184283 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1305041249999999, 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090271539999999997, 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184283 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888709+0000", 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888713+0000", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5700000000000001e-06 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888722+0000", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1959999999999997e-06 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888729+0000", 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.973e-06 2024-09-21T13:59:40.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978968+0000", 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090239216999999997 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978981+0000", 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3210000000000001e-05 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184284 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1304753920000001, 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090331687999999993, 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184284 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888738+0000", 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888741+0000", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.134e-06 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888750+0000", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6230000000000003e-06 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888757+0000", 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8959999999999997e-06 2024-09-21T13:59:40.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979048+0000", 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090291415999999999 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979070+0000", 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2232999999999999e-05 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184285 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1304149179999996, 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090311531, 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184285 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888798+0000", 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888802+0000", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888811+0000", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9830000000000002e-06 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888827+0000", 2024-09-21T13:59:40.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5699e-05 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979098+0000", 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090271325999999999 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979111+0000", 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2646000000000001e-05 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184286 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1303800820000003, 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090338091999999995, 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184286 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888833+0000", 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888843+0000", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0098999999999999e-05 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888852+0000", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2660000000000007e-06 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888859+0000", 2024-09-21T13:59:40.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0169999999999999e-06 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979149+0000", 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090290035000000005 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979172+0000", 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2588000000000001e-05 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184287 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1303397469999998, 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090367296, 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184287 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.066 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888877+0000", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2370000000000001e-06 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888886+0000", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7029999999999995e-06 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888893+0000", 2024-09-21T13:59:40.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.17e-06 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979229+0000", 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090335796999999995 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979242+0000", 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3003000000000001e-05 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1303152049999996, 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T13:59:40.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1302799759999997, 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T13:59:40.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1302546070000004, 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T13:59:40.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1302140649999997, 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T13:59:40.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1301732329999998, 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T13:59:40.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184439 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1224578669999996, 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090237591000000006, 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184439 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896759+0000", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1999999999999999e-06 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896768+0000", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1030000000000008e-06 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896775+0000", 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9190000000000002e-06 2024-09-21T13:59:40.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.986971+0000", 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090196436000000005 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.986994+0000", 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2532999999999999e-05 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184440 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1223949390000003, 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090243996000000007, 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184440 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896818+0000", 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896834+0000", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5458999999999999e-05 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896844+0000", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0076e-05 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896851+0000", 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.153e-06 2024-09-21T13:59:40.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987050+0000", 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090199451999999999 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987063+0000", 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2699e-05 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184441 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1223209389999997, 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090259289000000006, 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184441 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896892+0000", 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896896+0000", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8299999999999998e-06 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896905+0000", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3030000000000005e-06 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896912+0000", 2024-09-21T13:59:40.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9990000000000002e-06 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987130+0000", 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090217836999999995 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987152+0000", 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2215999999999999e-05 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184627 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7577600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.021476013, 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090278942000000001, 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184627 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997737+0000", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997741+0000", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997749+0000", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2490000000000001e-06 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997755+0000", 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3670000000000002e-06 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.087861+0000", 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090105861999999995 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.087942+0000", 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088017+0000", 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5358999999999995e-05 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0214494839999997, 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0214258120000004, 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T13:59:40.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T13:59:40.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.415962247, 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T13:59:40.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T13:59:40.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:59:40.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:40.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.121 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:40.123 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3784 write 0x3dc0829 thru 0x3dd07fd (0xffd5 bytes) 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3787 read 0x1167b6 thru 0x118f13 (0x275e bytes) 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3788 read 0xbc9dfa thru 0xbd64d9 (0xc6e0 bytes) 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3789 write 0xb0ff221 thru 0xb109e80 (0xac60 bytes) 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3792 writesame 0x43db983 thru 0x43e604b data_size 0x1(0xa6c9 bytes) 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:3796 writesame 0x2a7f59c thru 0x2a832a5 data_size 0xd(0x3d0a bytes) 2024-09-21T13:59:40.125 INFO:teuthology.orchestra.run.smithi079.stdout:3797 writesame 0x7e7df04 thru 0x7e89472 data_size 0x1(0xb56f bytes) 2024-09-21T13:59:40.125 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:40.120+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:40.140 INFO:teuthology.orchestra.run.smithi079.stdout:3798 writesame 0x259ae4e thru 0x25a60e0 data_size 0x29(0xb293 bytes) 2024-09-21T13:59:40.153 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.153 INFO:teuthology.orchestra.run.smithi079.stdout:3801 read 0x48e54af thru 0x48e70ad (0x1bff bytes) 2024-09-21T13:59:40.154 INFO:teuthology.orchestra.run.smithi079.stdout:3802 write 0x6299004 thru 0x62a5729 (0xc726 bytes) 2024-09-21T13:59:40.165 INFO:teuthology.orchestra.run.smithi079.stdout:3803 write 0x247abf6 thru 0x2481f46 (0x7351 bytes) 2024-09-21T13:59:40.169 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.169 INFO:teuthology.orchestra.run.smithi079.stdout:3805 write 0x9852574 thru 0x985c3cb (0x9e58 bytes) 2024-09-21T13:59:40.181 INFO:teuthology.orchestra.run.smithi079.stdout:3806 read 0x68bca1b thru 0x68c9b0a (0xd0f0 bytes) 2024-09-21T13:59:40.202 INFO:teuthology.orchestra.run.smithi079.stdout:3807 write 0xe259a3e thru 0xe259ba2 (0x165 bytes) 2024-09-21T13:59:40.207 INFO:teuthology.orchestra.run.smithi079.stdout:3808 read 0xe1b87b8 thru 0xe1bc9bb (0x4204 bytes) 2024-09-21T13:59:40.208 INFO:teuthology.orchestra.run.smithi079.stdout:3809 write 0xa248f66 thru 0xa24cade (0x3b79 bytes) 2024-09-21T13:59:40.217 INFO:teuthology.orchestra.run.smithi079.stdout:3810 write 0xc3264d3 thru 0xc3288b8 (0x23e6 bytes) 2024-09-21T13:59:40.224 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:40.224+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:40.225 INFO:teuthology.orchestra.run.smithi079.stdout:3811 write 0xb0dd001 thru 0xb0e4d0a (0x7d0a bytes) 2024-09-21T13:59:40.230 INFO:teuthology.orchestra.run.smithi079.stdout:3812 read 0x5853fbb thru 0x58613ac (0xd3f2 bytes) 2024-09-21T13:59:40.230 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.230 INFO:teuthology.orchestra.run.smithi079.stdout:3815 read 0xaf1c80e thru 0xaf20b47 (0x433a bytes) 2024-09-21T13:59:40.231 INFO:teuthology.orchestra.run.smithi079.stdout:3817 write 0xc4a0c4 thru 0xc53aa3 (0x99e0 bytes) 2024-09-21T13:59:40.236 INFO:teuthology.orchestra.run.smithi079.stdout:3818 write 0xa9b7d74 thru 0xa9c6944 (0xebd1 bytes) 2024-09-21T13:59:40.243 INFO:teuthology.orchestra.run.smithi079.stdout:3819 writesame 0xc4cf17f thru 0xc4da1ea data_size 0xe(0xb06c bytes) 2024-09-21T13:59:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:3820 read 0x861224c thru 0x862142a (0xf1df bytes) 2024-09-21T13:59:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:3822 punch from 0x947ead5 to 0x94820eb, (0x3616 bytes) 2024-09-21T13:59:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:3826 punch from 0xa6f7998 to 0xa6f9b6f, (0x21d7 bytes) 2024-09-21T13:59:40.256 INFO:teuthology.orchestra.run.smithi079.stdout:3827 read 0x7579649 thru 0x757e34e (0x4d06 bytes) 2024-09-21T13:59:40.277 INFO:teuthology.orchestra.run.smithi079.stdout:3828 trunc from 0xe259ba3 to 0x65d31bf 2024-09-21T13:59:40.301 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:40.301 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:40.301 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:40.302 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:40.307 INFO:teuthology.orchestra.run.smithi079.stdout:3829 read 0x4af662f thru 0x4afd896 (0x7268 bytes) 2024-09-21T13:59:40.307 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.307 INFO:teuthology.orchestra.run.smithi079.stdout:3832 punch from 0x3e8cbe to 0x3f6a18, (0xdd5a bytes) 2024-09-21T13:59:40.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:40.324 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:40.324+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:40.333 INFO:teuthology.orchestra.run.smithi079.stdout:3835 write 0xc943279 thru 0xc94e138 (0xaec0 bytes) 2024-09-21T13:59:40.345 INFO:teuthology.orchestra.run.smithi079.stdout:3836 punch from 0x987f6f to 0x990b92, (0x8c23 bytes) 2024-09-21T13:59:40.345 INFO:teuthology.orchestra.run.smithi079.stdout:3837 write 0xc53beea thru 0xc544221 (0x8338 bytes) 2024-09-21T13:59:40.358 INFO:teuthology.orchestra.run.smithi079.stdout:3838 writesame 0x8753b60 thru 0x875ec0b data_size 0x6(0xb0ac bytes) 2024-09-21T13:59:40.375 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.379 INFO:teuthology.orchestra.run.smithi079.stdout:3840 trunc from 0xc94e139 to 0xafea131 2024-09-21T13:59:40.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:59:40.399 INFO:teuthology.orchestra.run.smithi079.stdout:3841 read 0x8e2225a thru 0x8e2dfb6 (0xbd5d bytes) 2024-09-21T13:59:40.399 INFO:teuthology.orchestra.run.smithi079.stdout:3842 read 0x9f8e9bb thru 0x9f95f11 (0x7557 bytes) 2024-09-21T13:59:40.399 INFO:teuthology.orchestra.run.smithi079.stdout:3843 writesame 0x234116f thru 0x2345337 data_size 0x1(0x41c9 bytes) 2024-09-21T13:59:40.406 INFO:teuthology.orchestra.run.smithi079.stdout:3844 writesame 0xa6998ac thru 0xa69bef1 data_size 0x6(0x2646 bytes) 2024-09-21T13:59:40.412 INFO:teuthology.orchestra.run.smithi079.stdout:3845 write 0x7738f0c thru 0x7745705 (0xc7fa bytes) 2024-09-21T13:59:40.425 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:40.420+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:40.436 INFO:teuthology.orchestra.run.smithi079.stdout:3846 writesame 0xe02e254 thru 0xe038435 data_size 0x3(0xa1e2 bytes) 2024-09-21T13:59:40.437 INFO:teuthology.orchestra.run.smithi079.stdout:3847 write 0xc3ad7b6 thru 0xc3b733d (0x9b88 bytes) 2024-09-21T13:59:40.445 INFO:teuthology.orchestra.run.smithi079.stdout:3848 read 0x581be30 thru 0x5821260 (0x5431 bytes) 2024-09-21T13:59:40.445 INFO:teuthology.orchestra.run.smithi079.stdout:3849 read 0x5f69bf0 thru 0x5f7543d (0xb84e bytes) 2024-09-21T13:59:40.445 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:40.446 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:40.446 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.446 INFO:teuthology.orchestra.run.smithi079.stdout:3851 write 0x729e9dc thru 0x72ab65c (0xcc81 bytes) 2024-09-21T13:59:40.448 INFO:teuthology.orchestra.run.smithi079.stdout:3852 writesame 0x9f6aec7 thru 0x9f6c3bb data_size 0x5(0x14f5 bytes) 2024-09-21T13:59:40.452 INFO:teuthology.orchestra.run.smithi079.stdout:3853 write 0xc63a8d7 thru 0xc63ceca (0x25f4 bytes) 2024-09-21T13:59:40.454 INFO:teuthology.orchestra.run.smithi079.stdout:3854 writesame 0xbfe1081 thru 0xbfefc97 data_size 0x1(0xec17 bytes) 2024-09-21T13:59:40.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:40.471 INFO:teuthology.orchestra.run.smithi079.stdout:3855 read 0x71f35d0 thru 0x7201839 (0xe26a bytes) 2024-09-21T13:59:40.472 INFO:teuthology.orchestra.run.smithi079.stdout:3857 write 0xa605c22 thru 0xa6149ad (0xed8c bytes) 2024-09-21T13:59:40.478 INFO:teuthology.orchestra.run.smithi079.stdout:3858 punch from 0x7f2c90e to 0x7f380c6, (0xb7b8 bytes) 2024-09-21T13:59:40.478 INFO:teuthology.orchestra.run.smithi079.stdout:3859 writesame 0x346c147 thru 0x3473862 data_size 0x54(0x771c bytes) 2024-09-21T13:59:40.484 INFO:teuthology.orchestra.run.smithi079.stdout:3860 read 0x5ef6949 thru 0x5f019cb (0xb083 bytes) 2024-09-21T13:59:40.498 INFO:teuthology.orchestra.run.smithi079.stdout:3861 trunc from 0xe038436 to 0x732e19b 2024-09-21T13:59:40.516 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.516 INFO:teuthology.orchestra.run.smithi079.stdout:3863 read 0x389a6ed thru 0x389ab9c (0x4b0 bytes) 2024-09-21T13:59:40.517 INFO:teuthology.orchestra.run.smithi079.stdout:3865 read 0x5a98819 thru 0x5aa07f4 (0x7fdc bytes) 2024-09-21T13:59:40.535 INFO:teuthology.orchestra.run.smithi079.stdout:3867 write 0xea42b25 thru 0xea5152f (0xea0b bytes) 2024-09-21T13:59:40.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:40.545 INFO:teuthology.orchestra.run.smithi079.stdout:3868 write 0x70c0a79 thru 0x70c9056 (0x85de bytes) 2024-09-21T13:59:40.547 INFO:teuthology.orchestra.run.smithi079.stdout:3869 read 0xb31a0f3 thru 0xb326a15 (0xc923 bytes) 2024-09-21T13:59:40.547 INFO:teuthology.orchestra.run.smithi079.stdout:3870 write 0xca32782 thru 0xca3fac2 (0xd341 bytes) 2024-09-21T13:59:40.547 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:40.544+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:40.553 INFO:teuthology.orchestra.run.smithi079.stdout:3871 read 0x5c1c956 thru 0x5c23828 (0x6ed3 bytes) 2024-09-21T13:59:40.554 INFO:teuthology.orchestra.run.smithi079.stdout:3874 write 0x27bfcdf thru 0x27ca24e (0xa570 bytes) 2024-09-21T13:59:40.556 INFO:teuthology.orchestra.run.smithi079.stdout:3875 write 0x1fa3331 thru 0x1fa646e (0x313e bytes) 2024-09-21T13:59:40.558 INFO:teuthology.orchestra.run.smithi079.stdout:3878 punch from 0xe76fd71 to 0xe77ed0c, (0xef9b bytes) 2024-09-21T13:59:40.558 INFO:teuthology.orchestra.run.smithi079.stdout:3879 read 0x1d8cba1 thru 0x1d8fbdb (0x303b bytes) 2024-09-21T13:59:40.564 INFO:teuthology.orchestra.run.smithi079.stdout:3881 trunc from 0xea51530 to 0xa524c6b 2024-09-21T13:59:40.576 INFO:teuthology.orchestra.run.smithi079.stdout:3882 read 0xf84c67 thru 0xf8fcb3 (0xb04d bytes) 2024-09-21T13:59:40.577 INFO:teuthology.orchestra.run.smithi079.stdout:3883 read 0x8d78657 thru 0x8d7f6ab (0x7055 bytes) 2024-09-21T13:59:40.577 INFO:teuthology.orchestra.run.smithi079.stdout:3884 write 0x9054619 thru 0x905d9e7 (0x93cf bytes) 2024-09-21T13:59:40.586 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.586 INFO:teuthology.orchestra.run.smithi079.stdout:3886 read 0x11894dd thru 0x11945f1 (0xb115 bytes) 2024-09-21T13:59:40.587 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.600 INFO:teuthology.orchestra.run.smithi079.stdout:3888 trunc from 0xa524c6b to 0x102ddb9 2024-09-21T13:59:40.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:40.624+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:40.635 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191270 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10739712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.15134922, 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082303901999999998, 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191270 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481568+0000", 2024-09-21T13:59:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481575+0000", 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481612+0000", 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7095000000000003e-05 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481626+0000", 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3983e-05 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563684+0000", 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082058255999999996 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563780+0000", 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5972999999999997e-05 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563874+0000", 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3725000000000001e-05 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191271 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10780672~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1512804320000001, 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082453983999999994, 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191271 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481638+0000", 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481644+0000", 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6630000000000004e-06 2024-09-21T13:59:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481661+0000", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6546e-05 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481674+0000", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3086e-05 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563936+0000", 2024-09-21T13:59:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082262440000000006 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564018+0000", 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1483000000000006e-05 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564093+0000", 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4826000000000005e-05 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.15123324, 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T13:59:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1511851319999999, 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T13:59:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.151122924, 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T13:59:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T13:59:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.151074675, 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T13:59:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T13:59:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.151029327, 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T13:59:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T13:59:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.150982875, 2024-09-21T13:59:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T13:59:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T13:59:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.150937096, 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T13:59:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1508920380000001, 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T13:59:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1508475790000001, 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T13:59:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1507951910000001, 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1507621079999999, 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T13:59:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.150677181, 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T13:59:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.150630112, 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T13:59:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T13:59:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.150584917, 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T13:59:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T13:59:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1505273119999999, 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1490915230000001, 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.149013402, 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.1489641500000001, 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T13:59:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:40.727 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:40.728 INFO:teuthology.orchestra.run.smithi079.stdout:3890 write 0xed93396 thru 0xed9942e (0x6099 bytes) 2024-09-21T13:59:40.729 INFO:teuthology.orchestra.run.smithi079.stdout:3891 writesame 0xa982dd7 thru 0xa98bac0 data_size 0x11(0x8cea bytes) 2024-09-21T13:59:40.729 INFO:teuthology.orchestra.run.smithi079.stdout:3892 trunc from 0xed9942f to 0x8ed1f33 2024-09-21T13:59:40.729 INFO:teuthology.orchestra.run.smithi079.stdout:3893 trunc from 0x8ed1f33 to 0x4f90601 2024-09-21T13:59:40.729 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:40.729 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:40.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:40.730 INFO:teuthology.orchestra.run.smithi079.stdout:3894 read 0x10be89d thru 0x10bf512 (0xc76 bytes) 2024-09-21T13:59:40.730 INFO:teuthology.orchestra.run.smithi079.stdout:3896 read 0x35d309d thru 0x35d9c98 (0x6bfc bytes) 2024-09-21T13:59:40.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:40.731 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3898 writesame 0x9baa440 thru 0x9bba2e7 data_size 0x3a(0xfea8 bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3899 punch from 0x59ce813 to 0x59d1a1e, (0x320b bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3900 read 0x6e05ae6 thru 0x6e13f7a (0xe495 bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3901 punch from 0xad1f92 to 0xad1fee, (0x5c bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3902 punch from 0x6dee165 to 0x6df8210, (0xa0ab bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3903 read 0x89c542c thru 0x89c8313 (0x2ee8 bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3904 read 0x5e32438 thru 0x5e41010 (0xebd9 bytes) 2024-09-21T13:59:40.732 INFO:teuthology.orchestra.run.smithi079.stdout:3908 write 0x2d9fc74 thru 0x2da1f69 (0x22f6 bytes) 2024-09-21T13:59:40.733 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:40.728+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:40.733 INFO:teuthology.orchestra.run.smithi079.stdout:3909 read 0x22a8f08 thru 0x22b8673 (0xf76c bytes) 2024-09-21T13:59:40.738 INFO:teuthology.orchestra.run.smithi079.stdout:3910 trunc from 0x9bba2e8 to 0xd1414e7 2024-09-21T13:59:40.740 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:40.741 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:40.747 INFO:teuthology.orchestra.run.smithi079.stdout:3911 write 0x5f44875 thru 0x5f53a24 (0xf1b0 bytes) 2024-09-21T13:59:40.756 INFO:teuthology.orchestra.run.smithi079.stdout:3912 writesame 0xca5aaa2 thru 0xca65a57 data_size 0x7e(0xafb6 bytes) 2024-09-21T13:59:40.761 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:40.761 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:40.782 INFO:teuthology.orchestra.run.smithi079.stdout:3913 trunc from 0xd1414e7 to 0x25d98fb 2024-09-21T13:59:40.791 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:40.792 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:40.797 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.812 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:40.813 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:40.821 INFO:teuthology.orchestra.run.smithi079.stdout:3916 write 0xdababb9 thru 0xdac5254 (0xa69c bytes) 2024-09-21T13:59:40.829 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:40.828+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:40.832 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:40.832 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:40.832 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:40.836 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:40.837 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:40.844 INFO:teuthology.orchestra.run.smithi079.stdout:3917 trunc from 0xdac5255 to 0x4ded21b 2024-09-21T13:59:40.856 INFO:teuthology.orchestra.run.smithi079.stdout:3918 read 0x406b369 thru 0x4070454 (0x50ec bytes) 2024-09-21T13:59:40.856 INFO:teuthology.orchestra.run.smithi079.stdout:3919 punch from 0x4db1d9f to 0x4dbe26b, (0xc4cc bytes) 2024-09-21T13:59:40.856 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.878 INFO:teuthology.orchestra.run.smithi079.stdout:3922 write 0xda101e4 thru 0xda1617f (0x5f9c bytes) 2024-09-21T13:59:40.883 INFO:teuthology.orchestra.run.smithi079.stdout:3923 punch from 0x49ebab9 to 0x49f50f2, (0x9639 bytes) 2024-09-21T13:59:40.883 INFO:teuthology.orchestra.run.smithi079.stdout:3924 writesame 0xbbe665 thru 0xbc7e60 data_size 0x4(0x97fc bytes) 2024-09-21T13:59:40.891 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.891 INFO:teuthology.orchestra.run.smithi079.stdout:3926 read 0xb958738 thru 0xb967471 (0xed3a bytes) 2024-09-21T13:59:40.891 INFO:teuthology.orchestra.run.smithi079.stdout:3927 write 0xad2be70 thru 0xad37ffc (0xc18d bytes) 2024-09-21T13:59:40.899 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.900 INFO:teuthology.orchestra.run.smithi079.stdout:3929 read 0x13fdd4d thru 0x1407834 (0x9ae8 bytes) 2024-09-21T13:59:40.901 INFO:teuthology.orchestra.run.smithi079.stdout:3932 read 0x15a303b thru 0x15a9b13 (0x6ad9 bytes) 2024-09-21T13:59:40.901 INFO:teuthology.orchestra.run.smithi079.stdout:3933 write 0x61c57aa thru 0x61cec3f (0x9496 bytes) 2024-09-21T13:59:40.910 INFO:teuthology.orchestra.run.smithi079.stdout:3934 write 0x6978622 thru 0x6983c26 (0xb605 bytes) 2024-09-21T13:59:40.911 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:40.911 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:40.918 INFO:teuthology.orchestra.run.smithi079.stdout:3935 read 0xcc71c0a thru 0xcc7566f (0x3a66 bytes) 2024-09-21T13:59:40.918 INFO:teuthology.orchestra.run.smithi079.stdout:3936 write 0x804829d thru 0x8050f7c (0x8ce0 bytes) 2024-09-21T13:59:40.926 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:40.929 INFO:teuthology.orchestra.run.smithi079.stdout:3939 write 0x16ce71c thru 0x16dc81c (0xe101 bytes) 2024-09-21T13:59:40.930 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:40.928+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:40.937 INFO:teuthology.orchestra.run.smithi079.stdout:3941 punch from 0x99e1f92 to 0x99eefdb, (0xd049 bytes) 2024-09-21T13:59:40.937 INFO:teuthology.orchestra.run.smithi079.stdout:3942 punch from 0x3e5cd10 to 0x3e5f129, (0x2419 bytes) 2024-09-21T13:59:40.937 INFO:teuthology.orchestra.run.smithi079.stdout:3943 write 0x42be090 thru 0x42c6d9b (0x8d0c bytes) 2024-09-21T13:59:40.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:40.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:40.941 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T13:59:40.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T13:59:40.944 INFO:teuthology.orchestra.run.smithi079.stdout:3944 write 0x355c04a thru 0x356214c (0x6103 bytes) 2024-09-21T13:59:40.961 INFO:teuthology.orchestra.run.smithi079.stdout:3945 writesame 0xed625c5 thru 0xed6df82 data_size 0x32(0xb9be bytes) 2024-09-21T13:59:40.961 INFO:teuthology.orchestra.run.smithi079.stdout:3946 write 0x79fafba thru 0x79fe0b7 (0x30fe bytes) 2024-09-21T13:59:40.963 INFO:teuthology.orchestra.run.smithi079.stdout:3948 writesame 0x5cedc8b thru 0x5ceea62 data_size 0x4(0xdd8 bytes) 2024-09-21T13:59:40.973 INFO:teuthology.orchestra.run.smithi079.stdout:3949 trunc from 0xed6df83 to 0x9d890f0 2024-09-21T13:59:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:3952 punch from 0x3fe5c5c to 0x3ff289b, (0xcc3f bytes) 2024-09-21T13:59:40.989 INFO:teuthology.orchestra.run.smithi079.stdout:3953 writesame 0x4216228 thru 0x4219808 data_size 0x1(0x35e1 bytes) 2024-09-21T13:59:40.996 INFO:teuthology.orchestra.run.smithi079.stdout:3955 read 0x7beb40a thru 0x7bf5ca1 (0xa898 bytes) 2024-09-21T13:59:40.997 INFO:teuthology.orchestra.run.smithi079.stdout:3957 punch from 0x74ec3ee to 0x74ee564, (0x2176 bytes) 2024-09-21T13:59:40.998 INFO:teuthology.orchestra.run.smithi079.stdout:3959 trunc from 0x9d890f0 to 0x97b57de 2024-09-21T13:59:41.025 INFO:teuthology.orchestra.run.smithi079.stdout:3960 write 0xd441786 thru 0xd447093 (0x590e bytes) 2024-09-21T13:59:41.030 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:41.028+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:41.042 INFO:teuthology.orchestra.run.smithi079.stdout:3962 trunc from 0xd447094 to 0x81dd876 2024-09-21T13:59:41.057 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.058 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.062 INFO:teuthology.orchestra.run.smithi079.stdout:3963 read 0x751b2b5 thru 0x75242e8 (0x9034 bytes) 2024-09-21T13:59:41.062 INFO:teuthology.orchestra.run.smithi079.stdout:3964 punch from 0x28e1f0a to 0x28e892e, (0x6a24 bytes) 2024-09-21T13:59:41.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:41.081 INFO:teuthology.orchestra.run.smithi079.stdout:3965 writesame 0xdc89729 thru 0xdc95a45 data_size 0x1(0xc31d bytes) 2024-09-21T13:59:41.081 INFO:teuthology.orchestra.run.smithi079.stdout:3966 write 0x50dc8e1 thru 0x50dea05 (0x2125 bytes) 2024-09-21T13:59:41.085 INFO:teuthology.orchestra.run.smithi079.stdout:3967 read 0x152b978 thru 0x1534687 (0x8d10 bytes) 2024-09-21T13:59:41.086 INFO:teuthology.orchestra.run.smithi079.stdout:3968 read 0x636db04 thru 0x6375a52 (0x7f4f bytes) 2024-09-21T13:59:41.086 INFO:teuthology.orchestra.run.smithi079.stdout:3969 writesame 0xbe65172 thru 0xbe72d73 data_size 0x7e(0xdc02 bytes) 2024-09-21T13:59:41.095 INFO:teuthology.orchestra.run.smithi079.stdout:3970 punch from 0x270af8e to 0x2711ec9, (0x6f3b bytes) 2024-09-21T13:59:41.095 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.097 INFO:teuthology.orchestra.run.smithi079.stdout:3972 trunc from 0xdc95a46 to 0xc69533e 2024-09-21T13:59:41.105 INFO:teuthology.orchestra.run.smithi079.stdout:3973 read 0x11042f5 thru 0x11058df (0x15eb bytes) 2024-09-21T13:59:41.105 INFO:teuthology.orchestra.run.smithi079.stdout:3974 write 0x79d790b thru 0x79e4346 (0xca3c bytes) 2024-09-21T13:59:41.108 INFO:teuthology.orchestra.run.smithi079.stdout:3975 read 0x9fd2ece thru 0x9fd77e3 (0x4916 bytes) 2024-09-21T13:59:41.108 INFO:teuthology.orchestra.run.smithi079.stdout:3976 writesame 0xaf3b468 thru 0xaf4a0d5 data_size 0x2(0xec6e bytes) 2024-09-21T13:59:41.120 INFO:teuthology.orchestra.run.smithi079.stdout:3977 trunc from 0xc69533e to 0xbc40b92 2024-09-21T13:59:41.131 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:41.132+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:41.131 INFO:teuthology.orchestra.run.smithi079.stdout:3978 writesame 0x19c0c7b thru 0x19c134e data_size 0x2(0x6d4 bytes) 2024-09-21T13:59:41.148 INFO:teuthology.orchestra.run.smithi079.stdout:3983 trunc from 0xbc40b92 to 0x1c4efb6 2024-09-21T13:59:41.177 INFO:teuthology.orchestra.run.smithi079.stdout:3985 write 0x29d5e9c thru 0x29dff78 (0xa0dd bytes) 2024-09-21T13:59:41.204 INFO:teuthology.orchestra.run.smithi079.stdout:3986 trunc from 0x29dff79 to 0xe0f66d9 2024-09-21T13:59:41.205 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.205 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.214 INFO:teuthology.orchestra.run.smithi079.stdout:3987 write 0x84e87e9 thru 0x84f2a52 (0xa26a bytes) 2024-09-21T13:59:41.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:41.227 INFO:teuthology.orchestra.run.smithi079.stdout:3988 punch from 0xdd4f277 to 0xdd503d2, (0x115b bytes) 2024-09-21T13:59:41.227 INFO:teuthology.orchestra.run.smithi079.stdout:3989 write 0x8b291c7 thru 0x8b31037 (0x7e71 bytes) 2024-09-21T13:59:41.231 INFO:teuthology.orchestra.run.smithi079.stdout:3990 read 0x83e750b thru 0x83eabb6 (0x36ac bytes) 2024-09-21T13:59:41.231 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:41.228+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:41.232 INFO:teuthology.orchestra.run.smithi079.stdout:3991 writesame 0x2a37590 thru 0x2a41bc5 data_size 0x73(0xa636 bytes) 2024-09-21T13:59:41.235 INFO:teuthology.orchestra.run.smithi079.stdout:3994 writesame 0x1cbaafe thru 0x1cc50f6 data_size 0x3(0xa5f9 bytes) 2024-09-21T13:59:41.242 INFO:teuthology.orchestra.run.smithi079.stdout:3997 punch from 0x1d32d18 to 0x1d3a401, (0x76e9 bytes) 2024-09-21T13:59:41.243 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.243 INFO:teuthology.orchestra.run.smithi079.stdout:4000 read 0x87396fb thru 0x8742949 (0x924f bytes) 2024-09-21T13:59:41.244 INFO:teuthology.orchestra.run.smithi079.stdout:4002 read 0x94ecfa5 thru 0x94efc5b (0x2cb7 bytes) 2024-09-21T13:59:41.244 INFO:teuthology.orchestra.run.smithi079.stdout:4003 read 0xd19a21b thru 0xd1a7dd4 (0xdbba bytes) 2024-09-21T13:59:41.244 INFO:teuthology.orchestra.run.smithi079.stdout:4004 punch from 0x25ba125 to 0x25c239f, (0x827a bytes) 2024-09-21T13:59:41.245 INFO:teuthology.orchestra.run.smithi079.stdout:4005 read 0x5041db5 thru 0x50437ba (0x1a06 bytes) 2024-09-21T13:59:41.245 INFO:teuthology.orchestra.run.smithi079.stdout:4007 write 0x71b2cc thru 0x71cfc4 (0x1cf9 bytes) 2024-09-21T13:59:41.256 INFO:teuthology.orchestra.run.smithi079.stdout:4009 trunc from 0xe0f66d9 to 0x7540b39 2024-09-21T13:59:41.279 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:59:41.279 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:41.279 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 81, 2024-09-21T13:59:41.279 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T13:59:41.279 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-21T13:57:52.430765+0000", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-21T13:59:39.353598+0000", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-21T13:58:48.323579+0000", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-21T13:59:35.325085+0000", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5804032, 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-21T13:59:41.280 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "reef", 2024-09-21T13:59:41.281 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:05.200492+0000", 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:41.282 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:41.283 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "17", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:41.284 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:41.285 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:41.286 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 7.690000057220459, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 7.690000057220459, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.12999999523162842, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1, 2024-09-21T13:59:41.287 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:10.681325+0000", 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:41.288 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:41.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "21", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 21, 2024-09-21T13:59:41.290 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:41.291 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:41.292 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 3, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 3, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.75, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2.25, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2.25, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:41.293 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:20.114253+0000", 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T13:59:41.294 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T13:59:41.295 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "76", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 30, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 76, 2024-09-21T13:59:41.296 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T13:59:41.297 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T13:59:41.298 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 2, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 2, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.75, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T13:59:41.299 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "4f3cec52-e90a-4dc6-8a9d-879659a7f8b3", 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.300 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 45, 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-21T13:59:41.301 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.302 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.303 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6818/3285725925", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6823/3285725925", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/3285725925", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6827/3285725925", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "f30fdaae-2baf-49e5-b8c2-24477eabf5c6", 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.308349609375, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 23, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.306 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.308 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6819/1533952849", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6822/1533952849", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6830/1533952849", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6826/1533952849", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "54acbaba-89a5-4b6c-bd93-89e0683f2125", 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.311 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.1219024658203125, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 42, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T13:59:41.312 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/3403916996", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/3403916996", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/3403916996", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/3403916996", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.316 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "76fc66bf-6186-4666-b92f-c8093d20d625", 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.317 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 69, 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T13:59:41.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/3937234571", 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/3937234571", 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/3937234571", 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/3937234571", 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c90b7f74-168e-4c89-b1cf-c9ce463afa6e", 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 80, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.323 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6824", 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6825", 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.324 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6826", 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6827", 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6830", 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6831", 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6828", 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6829", 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.327 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6825/3468135680", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6827/3468135680", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3468135680", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3468135680", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "b837d993-44f1-4dd3-99f7-675e6abcd9c7", 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.328 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 77, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6816", 2024-09-21T13:59:41.329 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6817", 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6818", 2024-09-21T13:59:41.330 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6819", 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6822", 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6823", 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6820", 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6821", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6817/3245816486", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6819/3245816486", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6823/3245816486", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6821/3245816486", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c68ceefc-f355-4f66-870e-95ce4a9bc37e", 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 72, 2024-09-21T13:59:41.334 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6808", 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6809", 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6810", 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6811", 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6814", 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6815", 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6812", 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6813", 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.338 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6809/2399307560", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6811/2399307560", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2399307560", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2399307560", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "e1909a46-859c-45e8-b84b-0e11db556c48", 2024-09-21T13:59:41.339 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 0, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 39, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 45, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.340 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6800", 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6801", 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6802", 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6803", 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6806", 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6807", 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6804", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6805", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2163234632 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6801/2163234632", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6803/2163234632", 2024-09-21T13:59:41.344 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6807/2163234632", 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6805/2163234632", 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "exists" 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.345 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.368141+0000", 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343412+0000", 2024-09-21T13:59:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343898+0000", 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.347 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.285851+0000", 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.348 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.330406+0000", 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.349 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.151465+0000", 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.350 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.197502+0000", 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.171570+0000", 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 45 2024-09-21T13:59:41.351 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [ 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "2.3", 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: 5, 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: 2 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:41.352 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "3.9", 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: 4, 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: 2 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-21T13:59:41.353 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-21T13:59:41.354 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:41.355 INFO:teuthology.orchestra.run.smithi079.stdout:4010 write 0xc65ecad thru 0xc66d600 (0xe954 bytes) 2024-09-21T13:59:41.357 INFO:tasks.thrashosds.thrasher:j is {'epoch': 81, 'fsid': 'af11199c-39d9-4003-9df0-1f9fd66ab792', 'created': '2024-09-21T13:57:52.430765+0000', 'modified': '2024-09-21T13:59:39.353598+0000', 'last_up_change': '2024-09-21T13:58:48.323579+0000', 'last_in_change': '2024-09-21T13:59:35.325085+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:58:05.200492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T13:58:10.681325+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T13:58:20.114253+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 30, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 45, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6818', 'nonce': 3285725925}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 3285725925}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6829', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 3285725925}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6825', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 3285725925}]}, 'public_addr': '172.21.15.79:6818/3285725925', 'cluster_addr': '172.21.15.79:6823/3285725925', 'heartbeat_back_addr': '172.21.15.79:6831/3285725925', 'heartbeat_front_addr': '172.21.15.79:6827/3285725925', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'up': 1, 'in': 1, 'weight': 0.308349609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 23, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6817', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1533952849}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6821', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6822', 'nonce': 1533952849}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6830', 'nonce': 1533952849}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6826', 'nonce': 1533952849}]}, 'public_addr': '172.21.15.79:6819/1533952849', 'cluster_addr': '172.21.15.79:6822/1533952849', 'heartbeat_back_addr': '172.21.15.79:6830/1533952849', 'heartbeat_front_addr': '172.21.15.79:6826/1533952849', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '54acbaba-89a5-4b6c-bd93-89e0683f2125', 'up': 1, 'in': 1, 'weight': 0.1219024658203125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 3403916996}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 3403916996}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 3403916996}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 3403916996}]}, 'public_addr': '172.21.15.79:6801/3403916996', 'cluster_addr': '172.21.15.79:6803/3403916996', 'heartbeat_back_addr': '172.21.15.79:6807/3403916996', 'heartbeat_front_addr': '172.21.15.79:6805/3403916996', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76fc66bf-6186-4666-b92f-c8093d20d625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 3937234571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 3937234571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 3937234571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 3937234571}]}, 'public_addr': '172.21.15.79:6809/3937234571', 'cluster_addr': '172.21.15.79:6811/3937234571', 'heartbeat_back_addr': '172.21.15.79:6815/3937234571', 'heartbeat_front_addr': '172.21.15.79:6813/3937234571', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3468135680}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3468135680}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3468135680}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3468135680}]}, 'public_addr': '172.21.15.134:6825/3468135680', 'cluster_addr': '172.21.15.134:6827/3468135680', 'heartbeat_back_addr': '172.21.15.134:6831/3468135680', 'heartbeat_front_addr': '172.21.15.134:6829/3468135680', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 77, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 3245816486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 3245816486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 3245816486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 3245816486}]}, 'public_addr': '172.21.15.134:6817/3245816486', 'cluster_addr': '172.21.15.134:6819/3245816486', 'heartbeat_back_addr': '172.21.15.134:6823/3245816486', 'heartbeat_front_addr': '172.21.15.134:6821/3245816486', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2399307560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2399307560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2399307560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2399307560}]}, 'public_addr': '172.21.15.134:6809/2399307560', 'cluster_addr': '172.21.15.134:6811/2399307560', 'heartbeat_back_addr': '172.21.15.134:6815/2399307560', 'heartbeat_front_addr': '172.21.15.134:6813/2399307560', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e1909a46-859c-45e8-b84b-0e11db556c48', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 45, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 2163234632}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 2163234632}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 2163234632}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 2163234632}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 2163234632}]}, 'public_addr': '172.21.15.134:6801/2163234632', 'cluster_addr': '172.21.15.134:6803/2163234632', 'heartbeat_back_addr': '172.21.15.134:6807/2163234632', 'heartbeat_front_addr': '172.21.15.134:6805/2163234632', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.368141+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343412+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343898+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.285851+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.330406+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.151465+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.197502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.171570+0000', 'dead_epoch': 45}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.3', 'osds': [5, 2]}, {'pgid': '3.9', 'osds': [4, 2]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T13:59:41.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T13:59:41.358 INFO:teuthology.orchestra.run.smithi079.stdout:4011 write 0xecc952f thru 0xecd61cf (0xcca1 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4014 write 0xc391eb2 thru 0xc392d40 (0xe8f bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4015 read 0xc9e45de thru 0xc9eebae (0xa5d1 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4016 write 0xec6f0b thru 0xed1700 (0xa7f6 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4019 read 0x256f9f6 thru 0x257d9be (0xdfc9 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4020 read 0x285f5a5 thru 0x2865ad2 (0x652e bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4021 read 0x69ceca8 thru 0x69d3fe5 (0x533e bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4028 read 0x6612689 thru 0x6613bbe (0x1536 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4030 write 0x6598ed3 thru 0x65a8618 (0xf746 bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4031 punch from 0x4f9e2e6 to 0x4fa6d44, (0x8a5e bytes) 2024-09-21T13:59:41.359 INFO:teuthology.orchestra.run.smithi079.stdout:4034 trunc from 0xecd61d0 to 0x5efbca4 2024-09-21T13:59:41.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:41.356+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:41.360 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.360 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.366 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.366 INFO:teuthology.orchestra.run.smithi079.stdout:4037 read 0x255208 thru 0x264063 (0xee5c bytes) 2024-09-21T13:59:41.368 INFO:teuthology.orchestra.run.smithi079.stdout:4038 write 0x4e8587e thru 0x4e8f9ad (0xa130 bytes) 2024-09-21T13:59:41.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:41.381 INFO:teuthology.orchestra.run.smithi079.stdout:4039 punch from 0x4f4a5cc to 0x4f4f9ab, (0x53df bytes) 2024-09-21T13:59:41.383 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:59:41.384 INFO:teuthology.orchestra.run.smithi079.stdout:4040 trunc from 0x5efbca4 to 0x85073d1 2024-09-21T13:59:41.401 INFO:teuthology.orchestra.run.smithi079.stdout:4041 read 0x6b0cabd thru 0x6b1632a (0x986e bytes) 2024-09-21T13:59:41.402 INFO:teuthology.orchestra.run.smithi079.stdout:4042 punch from 0xdc7139 to 0xdd6d4c, (0xfc13 bytes) 2024-09-21T13:59:41.402 INFO:teuthology.orchestra.run.smithi079.stdout:4043 read 0x53b4e84 thru 0x53bb9a8 (0x6b25 bytes) 2024-09-21T13:59:41.402 INFO:teuthology.orchestra.run.smithi079.stdout:4044 writesame 0x4fcb2a thru 0x50a181 data_size 0x4c(0xd658 bytes) 2024-09-21T13:59:41.408 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:41.420 INFO:teuthology.orchestra.run.smithi079.stdout:4046 trunc from 0x85073d1 to 0x120abd1 2024-09-21T13:59:41.444 INFO:teuthology.orchestra.run.smithi079.stdout:4049 read 0x4217c4 thru 0x430a36 (0xf273 bytes) 2024-09-21T13:59:41.446 INFO:teuthology.orchestra.run.smithi079.stdout:4050 punch from 0x731416 to 0x73405e, (0x2c48 bytes) 2024-09-21T13:59:41.457 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:41.456+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:41.469 INFO:teuthology.orchestra.run.smithi079.stdout:4051 writesame 0x824f8ef thru 0x825f214 data_size 0x1(0xf926 bytes) 2024-09-21T13:59:41.487 INFO:teuthology.orchestra.run.smithi079.stdout:4052 writesame 0xb85d0ba thru 0xb8675df data_size 0x1(0xa526 bytes) 2024-09-21T13:59:41.502 INFO:teuthology.orchestra.run.smithi079.stdout:4053 writesame 0xdb56ebf thru 0xdb5e543 data_size 0x1(0x7685 bytes) 2024-09-21T13:59:41.502 INFO:teuthology.orchestra.run.smithi079.stdout:4055 read 0x3401ec thru 0x348e54 (0x8c69 bytes) 2024-09-21T13:59:41.503 INFO:teuthology.orchestra.run.smithi079.stdout:4056 write 0x4c8f183 thru 0x4c8fb4b (0x9c9 bytes) 2024-09-21T13:59:41.508 INFO:teuthology.orchestra.run.smithi079.stdout:4059 punch from 0x7b7ef7d to 0x7b81c82, (0x2d05 bytes) 2024-09-21T13:59:41.508 INFO:teuthology.orchestra.run.smithi079.stdout:4060 punch from 0x8764f6e to 0x876c240, (0x72d2 bytes) 2024-09-21T13:59:41.508 INFO:teuthology.orchestra.run.smithi079.stdout:4061 write 0x3862f6b thru 0x386c66c (0x9702 bytes) 2024-09-21T13:59:41.511 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.511 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.521 INFO:teuthology.orchestra.run.smithi079.stdout:4062 trunc from 0xdb5e544 to 0xba29453 2024-09-21T13:59:41.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:41.531 INFO:teuthology.orchestra.run.smithi079.stdout:4063 clone 28 order 24 su 131072 sc 13 2024-09-21T13:59:41.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:41.576+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:41.691 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.691 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.692 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:41.692 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:41.688+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:41.695 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T13:59:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T13:59:41.714 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-09-21T13:59:41.378899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1018975201,"num_objects":2003,"num_object_clones":547,"num_object_copies":4006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":710,"num_objects_misplaced":49,"num_objects_unfound":0,"num_objects_dirty":2003,"num_whiteouts":1033,"num_read":225465,"num_read_kb":666427,"num_write":11745,"num_write_kb":347214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":470,"num_bytes_recovered":30358071,"num_keys_recovered":24,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9788,"ondisk_log_size":9788,"up":64,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":801372,"kb_used_data":507352,"kb_used_omap":12,"kb_used_meta":293875,"kb_avail":754173348,"statfs":{"total":773094113280,"available":772273508352,"internally_reserved":0,"allocated":519528448,"data_stored":619587020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":300928568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90192644,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":32,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":7781,"num_read_kb":33615,"num_write":387,"num_write_kb":13306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":8997979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.232906"},"pg_stats":[{"pgid":"3.1f","version":"79'228","reported_seq":2031,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.363273+0000","last_change":"2024-09-21T13:58:23.675742+0000","last_active":"2024-09-21T13:59:38.363273+0000","last_peered":"2024-09-21T13:59:38.363273+0000","last_clean":"2024-09-21T13:59:38.363273+0000","last_became_active":"2024-09-21T13:58:21.669534+0000","last_became_peered":"2024-09-21T13:58:21.669534+0000","last_unstale":"2024-09-21T13:59:38.363273+0000","last_undegraded":"2024-09-21T13:59:38.363273+0000","last_fullsized":"2024-09-21T13:59:38.363273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:45:36.588526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001360329,"stat_sum":{"num_bytes":8612380,"num_objects":53,"num_object_clones":11,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":25,"num_read":2554,"num_read_kb":6657,"num_write":275,"num_write_kb":5353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"79'620","reported_seq":17400,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.357348+0000","last_change":"2024-09-21T13:58:23.678248+0000","last_active":"2024-09-21T13:59:38.357348+0000","last_peered":"2024-09-21T13:59:38.357348+0000","last_clean":"2024-09-21T13:59:38.357348+0000","last_became_active":"2024-09-21T13:58:21.657660+0000","last_became_peered":"2024-09-21T13:58:21.657660+0000","last_unstale":"2024-09-21T13:59:38.357348+0000","last_undegraded":"2024-09-21T13:59:38.357348+0000","last_fullsized":"2024-09-21T13:59:38.357348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:39:37.579715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084328099999999998,"stat_sum":{"num_bytes":64046864,"num_objects":77,"num_object_clones":26,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":36,"num_read":20300,"num_read_kb":50910,"num_write":841,"num_write_kb":21638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"77'428","reported_seq":3198,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.527493+0000","last_change":"2024-09-21T13:58:23.670095+0000","last_active":"2024-09-21T13:59:39.527493+0000","last_peered":"2024-09-21T13:59:39.527493+0000","last_clean":"2024-09-21T13:59:39.527493+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T13:59:39.527493+0000","last_undegraded":"2024-09-21T13:59:39.527493+0000","last_fullsized":"2024-09-21T13:59:39.527493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001560791,"stat_sum":{"num_bytes":32366084,"num_objects":59,"num_object_clones":17,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":32,"num_read":4877,"num_read_kb":22436,"num_write":555,"num_write_kb":12744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"80'254","reported_seq":3126,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.389928+0000","last_change":"2024-09-21T13:58:23.669852+0000","last_active":"2024-09-21T13:59:39.389928+0000","last_peered":"2024-09-21T13:59:39.389928+0000","last_clean":"2024-09-21T13:59:39.389928+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T13:59:39.389928+0000","last_undegraded":"2024-09-21T13:59:39.389928+0000","last_fullsized":"2024-09-21T13:59:39.389928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00131409,"stat_sum":{"num_bytes":24998518,"num_objects":67,"num_object_clones":17,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":32,"num_read":4179,"num_read_kb":16212,"num_write":297,"num_write_kb":12294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'194","reported_seq":1052,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.442249+0000","last_change":"2024-09-21T13:58:23.675985+0000","last_active":"2024-09-21T13:59:39.442249+0000","last_peered":"2024-09-21T13:59:39.442249+0000","last_clean":"2024-09-21T13:59:39.442249+0000","last_became_active":"2024-09-21T13:58:21.676815+0000","last_became_peered":"2024-09-21T13:58:21.676815+0000","last_unstale":"2024-09-21T13:59:39.442249+0000","last_undegraded":"2024-09-21T13:59:39.442249+0000","last_fullsized":"2024-09-21T13:59:39.442249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:36:26.965375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001600853,"stat_sum":{"num_bytes":25281323,"num_objects":62,"num_object_clones":16,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":37,"num_read":989,"num_read_kb":6667,"num_write":226,"num_write_kb":8005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"81'436","reported_seq":18100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.385226+0000","last_change":"2024-09-21T13:59:39.384402+0000","last_active":"2024-09-21T13:59:39.385226+0000","last_peered":"2024-09-21T13:59:39.385226+0000","last_clean":"2024-09-21T13:59:39.385226+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T13:59:39.385226+0000","last_undegraded":"2024-09-21T13:59:39.385226+0000","last_fullsized":"2024-09-21T13:59:39.385226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016660010000000001,"stat_sum":{"num_bytes":26588708,"num_objects":71,"num_object_clones":20,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":34,"num_read":18488,"num_read_kb":25701,"num_write":604,"num_write_kb":10308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"81'173","reported_seq":4558,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.539305+0000","last_change":"2024-09-21T13:58:43.393674+0000","last_active":"2024-09-21T13:59:39.539305+0000","last_peered":"2024-09-21T13:59:39.539305+0000","last_clean":"2024-09-21T13:59:39.539305+0000","last_became_active":"2024-09-21T13:58:43.296981+0000","last_became_peered":"2024-09-21T13:58:43.296981+0000","last_unstale":"2024-09-21T13:59:39.539305+0000","last_undegraded":"2024-09-21T13:59:39.539305+0000","last_fullsized":"2024-09-21T13:59:39.539305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.232425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086777700000000002,"stat_sum":{"num_bytes":36376678,"num_objects":66,"num_object_clones":15,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":32,"num_read":4380,"num_read_kb":29750,"num_write":162,"num_write_kb":9989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1534085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'360","reported_seq":32115,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.357133+0000","last_change":"2024-09-21T13:58:23.677180+0000","last_active":"2024-09-21T13:59:38.357133+0000","last_peered":"2024-09-21T13:59:38.357133+0000","last_clean":"2024-09-21T13:59:38.357133+0000","last_became_active":"2024-09-21T13:58:21.663122+0000","last_became_peered":"2024-09-21T13:58:21.663122+0000","last_unstale":"2024-09-21T13:59:38.357133+0000","last_undegraded":"2024-09-21T13:59:38.357133+0000","last_fullsized":"2024-09-21T13:59:38.357133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:42.212887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086548899999999999,"stat_sum":{"num_bytes":43408694,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":29,"num_read":32885,"num_read_kb":64391,"num_write":382,"num_write_kb":5443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"76'209","reported_seq":1023,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.363355+0000","last_change":"2024-09-21T13:58:23.676459+0000","last_active":"2024-09-21T13:59:38.363355+0000","last_peered":"2024-09-21T13:59:38.363355+0000","last_clean":"2024-09-21T13:59:38.363355+0000","last_became_active":"2024-09-21T13:58:21.666998+0000","last_became_peered":"2024-09-21T13:58:21.666998+0000","last_unstale":"2024-09-21T13:59:38.363355+0000","last_undegraded":"2024-09-21T13:59:38.363355+0000","last_fullsized":"2024-09-21T13:59:38.363355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:00.341695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019320850000000001,"stat_sum":{"num_bytes":34542255,"num_objects":59,"num_object_clones":19,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":843,"num_read_kb":31954,"num_write":201,"num_write_kb":12080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"80'246","reported_seq":1700,"reported_epoch":80,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:38.602542+0000","last_change":"2024-09-21T13:58:49.349861+0000","last_active":"2024-09-21T13:59:38.602542+0000","last_peered":"2024-09-21T13:59:38.602542+0000","last_clean":"2024-09-21T13:58:47.401560+0000","last_became_active":"2024-09-21T13:58:49.349861+0000","last_became_peered":"2024-09-21T13:58:49.349861+0000","last_unstale":"2024-09-21T13:59:38.602542+0000","last_undegraded":"2024-09-21T13:58:49.347806+0000","last_fullsized":"2024-09-21T13:58:49.347662+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:07:23.094358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052593799999999999,"stat_sum":{"num_bytes":23784260,"num_objects":70,"num_object_clones":19,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":70,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":39,"num_read":1810,"num_read_kb":13145,"num_write":331,"num_write_kb":13336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":70}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"81'243","reported_seq":2097,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.400697+0000","last_change":"2024-09-21T13:58:49.344838+0000","last_active":"2024-09-21T13:59:39.400697+0000","last_peered":"2024-09-21T13:59:39.400697+0000","last_clean":"2024-09-21T13:58:42.594814+0000","last_became_active":"2024-09-21T13:58:49.344838+0000","last_became_peered":"2024-09-21T13:58:49.344838+0000","last_unstale":"2024-09-21T13:59:39.400697+0000","last_undegraded":"2024-09-21T13:58:49.343098+0000","last_fullsized":"2024-09-21T13:58:49.342860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:17:03.360238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019725739999999999,"stat_sum":{"num_bytes":25545609,"num_objects":84,"num_object_clones":26,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":84,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":48,"num_read":2445,"num_read_kb":15343,"num_write":208,"num_write_kb":11101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":84}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"81'256","reported_seq":1499,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.376312+0000","last_change":"2024-09-21T13:58:49.345991+0000","last_active":"2024-09-21T13:59:39.376312+0000","last_peered":"2024-09-21T13:59:39.376312+0000","last_clean":"2024-09-21T13:58:47.374214+0000","last_became_active":"2024-09-21T13:58:49.345991+0000","last_became_peered":"2024-09-21T13:58:49.345991+0000","last_unstale":"2024-09-21T13:59:39.376312+0000","last_undegraded":"2024-09-21T13:58:49.343438+0000","last_fullsized":"2024-09-21T13:58:49.343217+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:38:28.504587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066536500000000001,"stat_sum":{"num_bytes":29200885,"num_objects":60,"num_object_clones":16,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":60,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":32,"num_read":1525,"num_read_kb":12768,"num_write":244,"num_write_kb":8567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":60}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+undersized","last_fresh":"2024-09-21T13:59:38.412240+0000","last_change":"2024-09-21T13:58:49.349507+0000","last_active":"2024-09-21T13:59:38.412240+0000","last_peered":"2024-09-21T13:59:38.412240+0000","last_clean":"2024-09-21T13:58:47.482553+0000","last_became_active":"2024-09-21T13:58:49.349507+0000","last_became_peered":"2024-09-21T13:58:49.349507+0000","last_unstale":"2024-09-21T13:59:38.412240+0000","last_undegraded":"2024-09-21T13:59:38.412240+0000","last_fullsized":"2024-09-21T13:58:49.346883+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:47:54.272627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"74'229","reported_seq":1678,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.363443+0000","last_change":"2024-09-21T13:58:43.329675+0000","last_active":"2024-09-21T13:59:38.363443+0000","last_peered":"2024-09-21T13:59:38.363443+0000","last_clean":"2024-09-21T13:59:38.363443+0000","last_became_active":"2024-09-21T13:58:43.309083+0000","last_became_peered":"2024-09-21T13:58:43.309083+0000","last_unstale":"2024-09-21T13:59:38.363443+0000","last_undegraded":"2024-09-21T13:59:38.363443+0000","last_fullsized":"2024-09-21T13:59:38.363443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:30:44.881146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00175307,"stat_sum":{"num_bytes":31673936,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":22,"num_read":2031,"num_read_kb":9467,"num_write":327,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":197,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.412266+0000","last_change":"2024-09-21T13:58:43.299441+0000","last_active":"2024-09-21T13:59:38.412266+0000","last_peered":"2024-09-21T13:59:38.412266+0000","last_clean":"2024-09-21T13:59:38.412266+0000","last_became_active":"2024-09-21T13:58:43.298888+0000","last_became_peered":"2024-09-21T13:58:43.298888+0000","last_unstale":"2024-09-21T13:59:38.412266+0000","last_undegraded":"2024-09-21T13:59:38.412266+0000","last_fullsized":"2024-09-21T13:59:38.412266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:39.790560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"80'422","reported_seq":3782,"reported_epoch":80,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:38.604637+0000","last_change":"2024-09-21T13:58:49.344834+0000","last_active":"2024-09-21T13:59:38.604637+0000","last_peered":"2024-09-21T13:59:38.604637+0000","last_clean":"2024-09-21T13:58:47.325945+0000","last_became_active":"2024-09-21T13:58:49.344834+0000","last_became_peered":"2024-09-21T13:58:49.344834+0000","last_unstale":"2024-09-21T13:59:38.604637+0000","last_undegraded":"2024-09-21T13:58:49.343139+0000","last_fullsized":"2024-09-21T13:58:49.342916+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:10:01.555627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080029400000000001,"stat_sum":{"num_bytes":26831243,"num_objects":81,"num_object_clones":22,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":81,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":43,"num_read":5286,"num_read_kb":16628,"num_write":529,"num_write_kb":10147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":81}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":80,"state":"active+undersized","last_fresh":"2024-09-21T13:59:38.363259+0000","last_change":"2024-09-21T13:58:49.349327+0000","last_active":"2024-09-21T13:59:38.363259+0000","last_peered":"2024-09-21T13:59:38.363259+0000","last_clean":"2024-09-21T13:58:10.922798+0000","last_became_active":"2024-09-21T13:58:49.349327+0000","last_became_peered":"2024-09-21T13:58:49.349327+0000","last_unstale":"2024-09-21T13:59:38.363259+0000","last_undegraded":"2024-09-21T13:59:38.363259+0000","last_fullsized":"2024-09-21T13:58:49.347361+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:51.892933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"76'660","reported_seq":5934,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.389924+0000","last_change":"2024-09-21T13:59:27.298466+0000","last_active":"2024-09-21T13:59:39.389924+0000","last_peered":"2024-09-21T13:59:39.389924+0000","last_clean":"2024-09-21T13:59:39.389924+0000","last_became_active":"2024-09-21T13:59:27.296108+0000","last_became_peered":"2024-09-21T13:59:27.296108+0000","last_unstale":"2024-09-21T13:59:39.389924+0000","last_undegraded":"2024-09-21T13:59:39.389924+0000","last_fullsized":"2024-09-21T13:59:39.389924+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:34.450575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000849941,"stat_sum":{"num_bytes":26393751,"num_objects":78,"num_object_clones":26,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":40,"num_read":7845,"num_read_kb":17564,"num_write":934,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":3643230,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":80,"state":"active+undersized","last_fresh":"2024-09-21T13:59:38.363453+0000","last_change":"2024-09-21T13:58:49.348678+0000","last_active":"2024-09-21T13:59:38.363453+0000","last_peered":"2024-09-21T13:59:38.363453+0000","last_clean":"2024-09-21T13:58:47.479962+0000","last_became_active":"2024-09-21T13:58:49.348678+0000","last_became_peered":"2024-09-21T13:58:49.348678+0000","last_unstale":"2024-09-21T13:59:38.363453+0000","last_undegraded":"2024-09-21T13:59:38.363453+0000","last_fullsized":"2024-09-21T13:58:49.347192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:40:54.311739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"81'431","reported_seq":19161,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.396148+0000","last_change":"2024-09-21T13:58:23.669217+0000","last_active":"2024-09-21T13:59:39.396148+0000","last_peered":"2024-09-21T13:59:39.396148+0000","last_clean":"2024-09-21T13:59:39.396148+0000","last_became_active":"2024-09-21T13:58:21.663305+0000","last_became_peered":"2024-09-21T13:58:21.663305+0000","last_unstale":"2024-09-21T13:59:39.396148+0000","last_undegraded":"2024-09-21T13:59:39.396148+0000","last_fullsized":"2024-09-21T13:59:39.396148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:31.775393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000695146,"stat_sum":{"num_bytes":68102080,"num_objects":70,"num_object_clones":20,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":30,"num_read":21419,"num_read_kb":56664,"num_write":529,"num_write_kb":20940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"80'133","reported_seq":596,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.604780+0000","last_change":"2024-09-21T13:58:23.661622+0000","last_active":"2024-09-21T13:59:38.604780+0000","last_peered":"2024-09-21T13:59:38.604780+0000","last_clean":"2024-09-21T13:59:38.604780+0000","last_became_active":"2024-09-21T13:58:21.669068+0000","last_became_peered":"2024-09-21T13:58:21.669068+0000","last_unstale":"2024-09-21T13:59:38.604780+0000","last_undegraded":"2024-09-21T13:59:38.604780+0000","last_fullsized":"2024-09-21T13:59:38.604780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:32:17.491597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072842200000000005,"stat_sum":{"num_bytes":19312604,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":32,"num_read":447,"num_read_kb":8950,"num_write":111,"num_write_kb":7756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":101,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.412344+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T13:59:38.412344+0000","last_peered":"2024-09-21T13:59:38.412344+0000","last_clean":"2024-09-21T13:59:38.412344+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T13:59:38.412344+0000","last_undegraded":"2024-09-21T13:59:38.412344+0000","last_fullsized":"2024-09-21T13:59:38.412344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"81'459","reported_seq":18378,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.463469+0000","last_change":"2024-09-21T13:59:27.296903+0000","last_active":"2024-09-21T13:59:39.463469+0000","last_peered":"2024-09-21T13:59:39.463469+0000","last_clean":"2024-09-21T13:59:39.463469+0000","last_became_active":"2024-09-21T13:59:27.294854+0000","last_became_peered":"2024-09-21T13:59:27.294854+0000","last_unstale":"2024-09-21T13:59:39.463469+0000","last_undegraded":"2024-09-21T13:59:39.463469+0000","last_fullsized":"2024-09-21T13:59:39.463469+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:35:18.751350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074414100000000003,"stat_sum":{"num_bytes":29690743,"num_objects":69,"num_object_clones":18,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":19121,"num_read_kb":20943,"num_write":574,"num_write_kb":6040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":5534373,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.357230+0000","last_change":"2024-09-21T13:59:24.259137+0000","last_active":"2024-09-21T13:59:38.357230+0000","last_peered":"2024-09-21T13:59:38.357230+0000","last_clean":"2024-09-21T13:59:38.357230+0000","last_became_active":"2024-09-21T13:59:24.258793+0000","last_became_peered":"2024-09-21T13:59:24.258793+0000","last_unstale":"2024-09-21T13:59:38.357230+0000","last_undegraded":"2024-09-21T13:59:38.357230+0000","last_fullsized":"2024-09-21T13:59:38.357230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:29:35.667344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"81'290","reported_seq":2902,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.389814+0000","last_change":"2024-09-21T13:58:23.674636+0000","last_active":"2024-09-21T13:59:39.389814+0000","last_peered":"2024-09-21T13:59:39.389814+0000","last_clean":"2024-09-21T13:59:39.389814+0000","last_became_active":"2024-09-21T13:58:21.669015+0000","last_became_peered":"2024-09-21T13:58:21.669015+0000","last_unstale":"2024-09-21T13:59:39.389814+0000","last_undegraded":"2024-09-21T13:59:39.389814+0000","last_fullsized":"2024-09-21T13:59:39.389814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:54:10.531946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055189900000000001,"stat_sum":{"num_bytes":49235105,"num_objects":65,"num_object_clones":19,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":30,"num_read":4184,"num_read_kb":16309,"num_write":389,"num_write_kb":19115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+undersized","last_fresh":"2024-09-21T13:59:38.363010+0000","last_change":"2024-09-21T13:58:49.348724+0000","last_active":"2024-09-21T13:59:38.363010+0000","last_peered":"2024-09-21T13:59:38.363010+0000","last_clean":"2024-09-21T13:58:41.297443+0000","last_became_active":"2024-09-21T13:58:49.348724+0000","last_became_peered":"2024-09-21T13:58:49.348724+0000","last_unstale":"2024-09-21T13:59:38.363010+0000","last_undegraded":"2024-09-21T13:59:38.363010+0000","last_fullsized":"2024-09-21T13:58:49.347121+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:23:48.936136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"77'319","reported_seq":17376,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.357736+0000","last_change":"2024-09-21T13:58:23.677582+0000","last_active":"2024-09-21T13:59:38.357736+0000","last_peered":"2024-09-21T13:59:38.357736+0000","last_clean":"2024-09-21T13:59:38.357736+0000","last_became_active":"2024-09-21T13:58:21.666129+0000","last_became_peered":"2024-09-21T13:58:21.666129+0000","last_unstale":"2024-09-21T13:59:38.357736+0000","last_undegraded":"2024-09-21T13:59:38.357736+0000","last_fullsized":"2024-09-21T13:59:38.357736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:34.646744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057054399999999998,"stat_sum":{"num_bytes":37238973,"num_objects":55,"num_object_clones":12,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":18989,"num_read_kb":49885,"num_write":299,"num_write_kb":14905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":85,"reported_epoch":80,"state":"active+clean+remapped","last_fresh":"2024-09-21T13:59:38.412282+0000","last_change":"2024-09-21T13:59:25.273442+0000","last_active":"2024-09-21T13:59:38.412282+0000","last_peered":"2024-09-21T13:59:38.412282+0000","last_clean":"2024-09-21T13:59:38.412282+0000","last_became_active":"2024-09-21T13:59:25.273036+0000","last_became_peered":"2024-09-21T13:59:25.273036+0000","last_unstale":"2024-09-21T13:59:38.412282+0000","last_undegraded":"2024-09-21T13:59:38.412282+0000","last_fullsized":"2024-09-21T13:59:38.412282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:06:50.290824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[{"shards":"2,5","objects":1}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":80,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:38.363194+0000","last_change":"2024-09-21T13:58:49.349376+0000","last_active":"2024-09-21T13:59:38.363194+0000","last_peered":"2024-09-21T13:59:38.363194+0000","last_clean":"2024-09-21T13:58:08.458314+0000","last_became_active":"2024-09-21T13:58:49.349376+0000","last_became_peered":"2024-09-21T13:58:49.349376+0000","last_unstale":"2024-09-21T13:59:38.363194+0000","last_undegraded":"2024-09-21T13:58:49.347735+0000","last_fullsized":"2024-09-21T13:58:49.347519+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:40:01.317817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"81'234","reported_seq":2414,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.387112+0000","last_change":"2024-09-21T13:58:49.344023+0000","last_active":"2024-09-21T13:59:39.387112+0000","last_peered":"2024-09-21T13:59:39.387112+0000","last_clean":"2024-09-21T13:58:47.326195+0000","last_became_active":"2024-09-21T13:58:49.344023+0000","last_became_peered":"2024-09-21T13:58:49.344023+0000","last_unstale":"2024-09-21T13:59:39.387112+0000","last_undegraded":"2024-09-21T13:58:49.342090+0000","last_fullsized":"2024-09-21T13:58:49.341860+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:36.575899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049768800000000004,"stat_sum":{"num_bytes":24065273,"num_objects":61,"num_object_clones":15,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":61,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":30,"num_read":3210,"num_read_kb":11682,"num_write":227,"num_write_kb":5441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":114001,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":61}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"79'220","reported_seq":1585,"reported_epoch":80,"state":"active+clean+remapped","last_fresh":"2024-09-21T13:59:38.359283+0000","last_change":"2024-09-21T13:59:25.269848+0000","last_active":"2024-09-21T13:59:38.359283+0000","last_peered":"2024-09-21T13:59:38.359283+0000","last_clean":"2024-09-21T13:59:38.359283+0000","last_became_active":"2024-09-21T13:59:25.269271+0000","last_became_peered":"2024-09-21T13:59:25.269271+0000","last_unstale":"2024-09-21T13:59:38.359283+0000","last_undegraded":"2024-09-21T13:59:38.359283+0000","last_fullsized":"2024-09-21T13:59:38.359283+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:04:02.828420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041472999999999998,"stat_sum":{"num_bytes":28428370,"num_objects":48,"num_object_clones":15,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":48,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":24,"num_read":2652,"num_read_kb":15851,"num_write":181,"num_write_kb":11894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[{"shards":"2,4","objects":48}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"81'476","reported_seq":15759,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.370992+0000","last_change":"2024-09-21T13:58:23.655496+0000","last_active":"2024-09-21T13:59:39.370992+0000","last_peered":"2024-09-21T13:59:39.370992+0000","last_clean":"2024-09-21T13:59:39.370992+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T13:59:39.370992+0000","last_undegraded":"2024-09-21T13:59:39.370992+0000","last_fullsized":"2024-09-21T13:59:39.370992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028276000000000001,"stat_sum":{"num_bytes":36478388,"num_objects":71,"num_object_clones":12,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":36,"num_read":17989,"num_read_kb":30712,"num_write":600,"num_write_kb":19057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"80'250","reported_seq":1784,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.602528+0000","last_change":"2024-09-21T13:58:23.677743+0000","last_active":"2024-09-21T13:59:38.602528+0000","last_peered":"2024-09-21T13:59:38.602528+0000","last_clean":"2024-09-21T13:59:38.602528+0000","last_became_active":"2024-09-21T13:58:21.663574+0000","last_became_peered":"2024-09-21T13:58:21.663574+0000","last_unstale":"2024-09-21T13:59:38.602528+0000","last_undegraded":"2024-09-21T13:59:38.602528+0000","last_fullsized":"2024-09-21T13:59:38.602528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:46:35.375920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065132199999999997,"stat_sum":{"num_bytes":19688478,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":28,"num_read":1974,"num_read_kb":6078,"num_write":319,"num_write_kb":12963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"81'182","reported_seq":1158,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T13:59:39.390224+0000","last_change":"2024-09-21T13:58:23.670213+0000","last_active":"2024-09-21T13:59:39.390224+0000","last_peered":"2024-09-21T13:59:39.390224+0000","last_clean":"2024-09-21T13:59:39.390224+0000","last_became_active":"2024-09-21T13:58:21.664427+0000","last_became_peered":"2024-09-21T13:58:21.664427+0000","last_unstale":"2024-09-21T13:59:39.390224+0000","last_undegraded":"2024-09-21T13:59:39.390224+0000","last_fullsized":"2024-09-21T13:59:39.390224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.275392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016929460000000001,"stat_sum":{"num_bytes":25554318,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":33,"num_read":999,"num_read_kb":5719,"num_write":174,"num_write_kb":5917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"75'153","reported_seq":2077,"reported_epoch":80,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:38.412333+0000","last_change":"2024-09-21T13:58:49.349983+0000","last_active":"2024-09-21T13:59:38.412333+0000","last_peered":"2024-09-21T13:59:38.412333+0000","last_clean":"2024-09-21T13:58:44.302816+0000","last_became_active":"2024-09-21T13:58:49.349983+0000","last_became_peered":"2024-09-21T13:58:49.349983+0000","last_unstale":"2024-09-21T13:59:38.412333+0000","last_undegraded":"2024-09-21T13:58:49.347741+0000","last_fullsized":"2024-09-21T13:58:49.347507+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:06:05.280393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002170155,"stat_sum":{"num_bytes":18171259,"num_objects":50,"num_object_clones":15,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":50,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":30,"num_read":1920,"num_read_kb":8201,"num_write":296,"num_write_kb":5591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":50}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"81'275","reported_seq":3878,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.532400+0000","last_change":"2024-09-21T13:58:49.347430+0000","last_active":"2024-09-21T13:59:39.532400+0000","last_peered":"2024-09-21T13:59:39.532400+0000","last_clean":"2024-09-21T13:58:44.302788+0000","last_became_active":"2024-09-21T13:58:49.347430+0000","last_became_peered":"2024-09-21T13:58:49.347430+0000","last_unstale":"2024-09-21T13:59:39.532400+0000","last_undegraded":"2024-09-21T13:58:49.344228+0000","last_fullsized":"2024-09-21T13:58:49.344027+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:40:06.631762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020942769999999999,"stat_sum":{"num_bytes":42498986,"num_objects":71,"num_object_clones":21,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":71,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":32,"num_read":4332,"num_read_kb":10742,"num_write":308,"num_write_kb":7764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":71}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"81'203","reported_seq":4178,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.376468+0000","last_change":"2024-09-21T13:58:49.346164+0000","last_active":"2024-09-21T13:59:39.376468+0000","last_peered":"2024-09-21T13:59:39.376468+0000","last_clean":"2024-09-21T13:58:43.424927+0000","last_became_active":"2024-09-21T13:58:49.346164+0000","last_became_peered":"2024-09-21T13:58:49.346164+0000","last_unstale":"2024-09-21T13:59:39.376468+0000","last_undegraded":"2024-09-21T13:58:49.343462+0000","last_fullsized":"2024-09-21T13:58:49.343272+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:47:32.284679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023754330000000001,"stat_sum":{"num_bytes":48718857,"num_objects":75,"num_object_clones":26,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":75,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":36,"num_read":4451,"num_read_kb":15440,"num_write":244,"num_write_kb":12440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":75}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"79'366","reported_seq":2711,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-21T13:59:38.412210+0000","last_change":"2024-09-21T13:58:23.655760+0000","last_active":"2024-09-21T13:59:38.412210+0000","last_peered":"2024-09-21T13:59:38.412210+0000","last_clean":"2024-09-21T13:59:38.412210+0000","last_became_active":"2024-09-21T13:58:21.663533+0000","last_became_peered":"2024-09-21T13:58:21.663533+0000","last_unstale":"2024-09-21T13:59:38.412210+0000","last_undegraded":"2024-09-21T13:59:38.412210+0000","last_fullsized":"2024-09-21T13:59:38.412210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:10:28.340647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040902700000000001,"stat_sum":{"num_bytes":20662196,"num_objects":63,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":33,"num_read":3216,"num_read_kb":18782,"num_write":399,"num_write_kb":11459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"79'152","reported_seq":3092,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.532741+0000","last_change":"2024-09-21T13:58:49.345140+0000","last_active":"2024-09-21T13:59:39.532741+0000","last_peered":"2024-09-21T13:59:39.532741+0000","last_clean":"2024-09-21T13:58:43.442180+0000","last_became_active":"2024-09-21T13:58:49.345140+0000","last_became_peered":"2024-09-21T13:58:49.345140+0000","last_unstale":"2024-09-21T13:59:39.532741+0000","last_undegraded":"2024-09-21T13:58:49.343366+0000","last_fullsized":"2024-09-21T13:58:49.343141+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:19:11.435175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002246072,"stat_sum":{"num_bytes":28192992,"num_objects":59,"num_object_clones":17,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":59,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":31,"num_read":2951,"num_read_kb":25245,"num_write":128,"num_write_kb":9587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":59}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"81'379","reported_seq":2892,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.453600+0000","last_change":"2024-09-21T13:58:49.347981+0000","last_active":"2024-09-21T13:59:39.453600+0000","last_peered":"2024-09-21T13:59:39.453600+0000","last_clean":"2024-09-21T13:58:47.479950+0000","last_became_active":"2024-09-21T13:58:49.347981+0000","last_became_peered":"2024-09-21T13:58:49.347981+0000","last_unstale":"2024-09-21T13:59:39.453600+0000","last_undegraded":"2024-09-21T13:58:49.347165+0000","last_fullsized":"2024-09-21T13:58:49.347073+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:39:03.998125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092102899999999997,"stat_sum":{"num_bytes":36460302,"num_objects":51,"num_object_clones":11,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":51,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":25,"num_read":5296,"num_read_kb":20318,"num_write":530,"num_write_kb":15964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"81'188","reported_seq":985,"reported_epoch":81,"state":"active+undersized+degraded","last_fresh":"2024-09-21T13:59:39.376176+0000","last_change":"2024-09-21T13:58:49.348561+0000","last_active":"2024-09-21T13:59:39.376176+0000","last_peered":"2024-09-21T13:59:39.376176+0000","last_clean":"2024-09-21T13:58:43.294386+0000","last_became_active":"2024-09-21T13:58:49.348561+0000","last_became_peered":"2024-09-21T13:58:49.348561+0000","last_unstale":"2024-09-21T13:59:39.376176+0000","last_undegraded":"2024-09-21T13:58:49.343480+0000","last_fullsized":"2024-09-21T13:58:49.343267+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:57:37.638338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001731343,"stat_sum":{"num_bytes":26234702,"num_objects":46,"num_object_clones":13,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":24,"num_read":1762,"num_read_kb":5213,"num_write":160,"num_write_kb":4878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":46}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1018384814,"num_objects":1999,"num_object_clones":547,"num_object_copies":3998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":708,"num_objects_misplaced":48,"num_objects_unfound":0,"num_objects_dirty":1999,"num_whiteouts":1033,"num_read":225349,"num_read_kb":666327,"num_write":11584,"num_write_kb":344796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":468,"num_bytes_recovered":30358033,"num_keys_recovered":24,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":502304768,"data_stored":604568561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9668,"ondisk_log_size":9668,"up":52,"acting":53,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":11,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42168,"kb_used_data":11044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94329672,"statfs":{"total":96636764160,"available":96593584128,"internally_reserved":0,"allocated":11309056,"data_stored":19475294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80236,"kb_used_data":45020,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94291604,"statfs":{"total":96636764160,"available":96554602496,"internally_reserved":0,"allocated":46100480,"data_stored":54760956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36043207},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.748}]},{"osd":2,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.008},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.626},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.94699999999999995}]},{"osd":4,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.042},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":133372,"kb_used_data":94056,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94238468,"statfs":{"total":96636764160,"available":96500191232,"internally_reserved":0,"allocated":96313344,"data_stored":114343401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.71899999999999997}]},{"osd":2,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":6.1299999999999999,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183360,"kb_used_data":139944,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94188480,"statfs":{"total":96636764160,"available":96449003520,"internally_reserved":0,"allocated":143302656,"data_stored":170020381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,9],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":2.694,"5min":2.694,"15min":2.694},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":39.390000000000001,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.498},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":8.4450000000000003,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":41.155000000000001,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.97699999999999998}]},{"osd":5,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.2559999999999998,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.59499999999999997}]},{"osd":6,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":36.741999999999997,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131024,"kb_used_data":91712,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94240816,"statfs":{"total":96636764160,"available":96502595584,"internally_reserved":0,"allocated":93913088,"data_stored":113554878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.32000000000000001}]},{"osd":1,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":5.4119999999999999,"5min":5.4119999999999999,"15min":5.4119999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.28499999999999998}]},{"osd":2,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":5.4429999999999996,"5min":5.4429999999999996,"15min":5.4429999999999996},"last":0.67500000000000004}]},{"osd":4,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":5.5279999999999996,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":4.4340000000000002}]},{"osd":5,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.378},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.42899999999999999}]},{"osd":6,"last update":"Sat Sep 21 13:59:04 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.556,"5min":5.556,"15min":5.556},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46596,"kb_used_data":11384,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94325244,"statfs":{"total":96636764160,"available":96589049856,"internally_reserved":0,"allocated":11657216,"data_stored":14769952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":0.40799999999999997}]},{"osd":1,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":19.757000000000001,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":19.652999999999999,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.63200000000000001}]},{"osd":4,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.609,"5min":1.609,"15min":1.609},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":8.0730000000000004,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.79900000000000004}]},{"osd":5,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.96599999999999997}]},{"osd":6,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.675,"5min":1.675,"15min":1.675},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40952,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330888,"statfs":{"total":96636764160,"available":96594829312,"internally_reserved":0,"allocated":10072064,"data_stored":11231311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.371}]},{"osd":3,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":0.435}]},{"osd":4,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.51400000000000001}]},{"osd":6,"last update":"Sat Sep 21 13:59:07 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.48,"5min":2.48,"15min":2.48},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143664,"kb_used_data":104356,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94228176,"statfs":{"total":96636764160,"available":96489652224,"internally_reserved":0,"allocated":106860544,"data_stored":121430847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":7.1769999999999996,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.47599999999999998}]},{"osd":3,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":11.84,"5min":11.84,"15min":11.84},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0009999999999999}]},{"osd":5,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":4.3710000000000004,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.97799999999999998}]},{"osd":6,"last update":"Sat Sep 21 13:59:06 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2859999999999996,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":96280576,"data_stored":109681719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9134080,"data_stored":10812240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":14336837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":93032448,"data_stored":113183192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":142348288,"data_stored":169587266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":95367168,"data_stored":113920940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45174784,"data_stored":54348933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10264576,"data_stored":18697434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T13:59:41.717 INFO:tasks.thrashosds.thrasher:Setting 3.1b to [5, 4, 0, 1] 2024-09-21T13:59:41.717 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.1b', '5', '4', '0', '1'] 2024-09-21T13:59:41.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.1b 5 4 0 1 2024-09-21T13:59:41.807 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:41.808+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:41.822 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.823 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:41.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:41.924 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:41.924+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:41.993 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:41.988+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:41.995 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:41.995 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.010 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:42.094 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:42.088+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:42.171 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.172 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:42.195 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:42.192+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:42.296 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:42.296+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:42.309 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.310 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:42.381 INFO:teuthology.orchestra.run.smithi079.stderr:set 3.1b pg_upmap_items mapping to [5->4,0->1] 2024-09-21T13:59:42.397 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:42.396+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:42.452 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.453 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:42.498 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:42.492+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:42.586 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.586 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.598 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:42.596+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:42.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:42.651 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-21T13:59:42.671 INFO:teuthology.orchestra.run.smithi079.stdout:4065 write 0xc027312 thru 0xc02f1e7 (0x7ed6 bytes) 2024-09-21T13:59:42.699 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:42.696+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:42.761 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.761 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:42.824 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:42.824+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:42.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:42.911 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:42.912+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:42.949 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:42.949 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:42.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:43.006 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:43.007 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:43.007 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:43.004+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:43.023 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:43.023 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:43.039 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:43.039 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:43.055 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:43.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:43.075 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:43.075 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:43.095 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:43.095 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:43.102 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:43.100+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:43.114 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:43.119 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:43.119 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:43.120 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:43.120 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:43.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:43.120 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.718664064000002, 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.678577226000002, 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.125 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:43.129 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.617263970000003, 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133358 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 76800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.309059275000003, 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058918719000000001, 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133358 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811182+0000", 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811181+0000", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811185+0000", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811193+0000", 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1289999999999996e-06 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811200+0000", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7129999999999999e-06 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869833+0000", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058633115999999999 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.869948+0000", 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115584 2024-09-21T13:59:43.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870101+0000", 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152287 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133359 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.309035807000001, 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059286298000000001, 2024-09-21T13:59:43.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133359 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811206+0000", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811205+0000", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811208+0000", 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2729999999999998e-06 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811216+0000", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.259e-06 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811223+0000", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6259999999999997e-06 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870168+0000", 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.058945164000000001 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870311+0000", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142464 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870492+0000", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000181118 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133360 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 87040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:43.142 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.309012670999998, 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059596781000000001, 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133360 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811229+0000", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811228+0000", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811231+0000", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.196e-06 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811239+0000", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0330000000000008e-06 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811246+0000", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6100000000000002e-06 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870555+0000", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059309029999999999 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870673+0000", 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118363 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870825+0000", 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015213600000000001 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133361 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 92160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308989830000002, 2024-09-21T13:59:43.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059958546000000001, 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133361 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811251+0000", 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811254+0000", 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.337e-06 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811262+0000", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1659999999999994e-06 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811269+0000", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5930000000000002e-06 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.870893+0000", 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059623968999999999 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871028+0000", 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000135501 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871210+0000", 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018161699999999999 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133362 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 97280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308966497999997, 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060278945, 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133362 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811275+0000", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811274+0000", 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811277+0000", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2030000000000001e-06 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811285+0000", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9119999999999998e-06 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811292+0000", 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6200000000000001e-06 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871273+0000", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059980588000000001 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871400+0000", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127525 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871554+0000", 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015371300000000001 2024-09-21T13:59:43.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133363 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 103424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308928930999997, 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060623992000000002, 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133363 2024-09-21T13:59:43.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811312+0000", 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811315+0000", 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3529999999999999e-06 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811324+0000", 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5089999999999993e-06 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811330+0000", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5799999999999997e-06 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871620+0000", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060289397000000002 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871753+0000", 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132908 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871936+0000", 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000183881 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133364 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308905369000001, 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060935982, 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133364 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811336+0000", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811335+0000", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811339+0000", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2229999999999999e-06 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811347+0000", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2730000000000002e-06 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811353+0000", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5989999999999998e-06 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.871999+0000", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060645731000000001 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872119+0000", 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119867 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872272+0000", 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015293199999999999 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133365 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 113664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.163 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308882144000002, 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.06130443, 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133365 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811359+0000", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811362+0000", 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2160000000000002e-06 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811370+0000", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811376+0000", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3799999999999999e-06 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872342+0000", 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060965424999999997 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872482+0000", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014024400000000001 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872664+0000", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018166499999999999 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133366 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 118784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:43.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308859214999998, 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061625971000000002, 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133366 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811382+0000", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811385+0000", 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.332e-06 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811393+0000", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1170000000000004e-06 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811400+0000", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6889999999999998e-06 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872726+0000", 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061325932999999999 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.872856+0000", 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130588 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873008+0000", 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000151905 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.171 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133367 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 123904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308836016999997, 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061995883000000002, 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133367 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811405+0000", 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811408+0000", 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.14e-06 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811416+0000", 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0490000000000004e-06 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811422+0000", 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873082+0000", 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061659985 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873224+0000", 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014196400000000001 2024-09-21T13:59:43.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873401+0000", 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017682099999999999 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133368 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 129024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308813301999997, 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062336753000000002, 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133368 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811428+0000", 2024-09-21T13:59:43.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811427+0000", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811454+0000", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6825000000000002e-05 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811464+0000", 2024-09-21T13:59:43.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5990000000000008e-06 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811471+0000", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873463+0000", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061991549 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873609+0000", 2024-09-21T13:59:43.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014674999999999999 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873765+0000", 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000155456 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133369 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 135168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308764068000002, 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062595426999999995, 2024-09-21T13:59:43.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133369 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:43.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811477+0000", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811480+0000", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.18e-06 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811488+0000", 2024-09-21T13:59:43.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3529999999999995e-06 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811495+0000", 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.686e-06 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873807+0000", 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062312233000000002 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.873921+0000", 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113486 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874073+0000", 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000152156 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133370 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 140288~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308740763000003, 2024-09-21T13:59:43.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063038644000000005, 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133370 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811501+0000", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811500+0000", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811503+0000", 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5020000000000001e-06 2024-09-21T13:59:43.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811512+0000", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2130000000000008e-06 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811518+0000", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7660000000000001e-06 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874173+0000", 2024-09-21T13:59:43.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062654177000000005 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874335+0000", 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016219499999999999 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874539+0000", 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000204417 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133371 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 145408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308717375000001, 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0633967, 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133371 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811524+0000", 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811523+0000", 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811527+0000", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811535+0000", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811542+0000", 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.793e-06 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874635+0000", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063093623000000001 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874762+0000", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012691199999999999 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874921+0000", 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015848899999999999 2024-09-21T13:59:43.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133372 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 150528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308694056, 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063676675000000002, 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133372 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811547+0000", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811550+0000", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1889999999999999e-06 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811558+0000", 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1769999999999998e-06 2024-09-21T13:59:43.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811565+0000", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6390000000000003e-06 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.874963+0000", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063398191000000007 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875075+0000", 2024-09-21T13:59:43.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011169499999999999 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875224+0000", 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014938700000000001 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133373 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 155648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:43.197 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308668877999999, 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064102759999999995, 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133373 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811572+0000", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811575+0000", 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0539999999999999e-06 2024-09-21T13:59:43.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811583+0000", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4090000000000003e-06 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811590+0000", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0559999999999999e-06 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875318+0000", 2024-09-21T13:59:43.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.063727151999999995 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875477+0000", 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015933500000000001 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875675+0000", 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019835400000000001 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:133374 3.7 3:e7cb07dd:::rbd_data.1185dbcc99d3.0000000000000053:11 [read 160768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54)", 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.308642186, 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064394145999999999, 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 133374 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811599+0000", 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811598+0000", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811603+0000", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2499999999999997e-06 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811619+0000", 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5736e-05 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.811633+0000", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3862e-05 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875721+0000", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064088110000000004 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875838+0000", 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116801 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:43.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:01.875993+0000", 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015558400000000001 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:43.206 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:43.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:43.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:43.208+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:43.308 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:43.308+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:43.338 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:43.338 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:43.338 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:43.338 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:43.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:43.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:59:43.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:43.408+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:43.475 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:43.475 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:43.475 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:43.475 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:43.475 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:43.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:43.511 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:43.508+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:43.606 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:43.606 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184280 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7165738990000001, 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090236616000000006, 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184280 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888575+0000", 2024-09-21T13:59:43.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888578+0000", 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2200000000000001e-06 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888587+0000", 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5429999999999994e-06 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888594+0000", 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2729999999999997e-06 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978789+0000", 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090195136999999995 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978812+0000", 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3057e-05 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184281 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7165164449999999, 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090219523999999995, 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184281 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888633+0000", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888632+0000", 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888644+0000", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1962e-05 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888656+0000", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.184e-05 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888663+0000", 2024-09-21T13:59:43.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1400000000000002e-06 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978840+0000", 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090176651999999996 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978852+0000", 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2839e-05 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184282 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7164790500000002, 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090241523000000004, 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184282 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888670+0000", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888669+0000", 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888673+0000", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6059999999999999e-06 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888681+0000", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4600000000000003e-06 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888688+0000", 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.99e-06 2024-09-21T13:59:43.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978889+0000", 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090201105000000004 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978912+0000", 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2308000000000001e-05 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184283 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7164394309999995, 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090271539999999997, 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184283 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:43.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888710+0000", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888709+0000", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888713+0000", 2024-09-21T13:59:43.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5700000000000001e-06 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888722+0000", 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1959999999999997e-06 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888729+0000", 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.973e-06 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978968+0000", 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090239216999999997 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.978981+0000", 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3210000000000001e-05 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184284 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:43.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7164106980000007, 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090331687999999993, 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184284 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888739+0000", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888738+0000", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888741+0000", 2024-09-21T13:59:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.134e-06 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888750+0000", 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6230000000000003e-06 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888757+0000", 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8959999999999997e-06 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979048+0000", 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090291415999999999 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979070+0000", 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2232999999999999e-05 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184285 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7163502239999993, 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090311531, 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184285 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888799+0000", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888798+0000", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888802+0000", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888811+0000", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9830000000000002e-06 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888827+0000", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5699e-05 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979098+0000", 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090271325999999999 2024-09-21T13:59:43.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979111+0000", 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2646000000000001e-05 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184286 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7163153879999999, 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090338091999999995, 2024-09-21T13:59:43.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184286 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888834+0000", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888833+0000", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888843+0000", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0098999999999999e-05 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888852+0000", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2660000000000007e-06 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888859+0000", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0169999999999999e-06 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979149+0000", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090290035000000005 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979172+0000", 2024-09-21T13:59:43.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2588000000000001e-05 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184287 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7162750530000004, 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090367296, 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184287 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888874+0000", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888877+0000", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2370000000000001e-06 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888886+0000", 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7029999999999995e-06 2024-09-21T13:59:43.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888893+0000", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.17e-06 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979229+0000", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090335796999999995 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979242+0000", 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3003000000000001e-05 2024-09-21T13:59:43.637 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7162505110000001, 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.638 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.641 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7162152820000003, 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T13:59:43.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T13:59:43.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7161899130000009, 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T13:59:43.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7161493710000002, 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:43.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7161085390000004, 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T13:59:43.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T13:59:43.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184439 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7083931729999993, 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090237591000000006, 2024-09-21T13:59:43.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184439 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896756+0000", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896759+0000", 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1999999999999999e-06 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896768+0000", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1030000000000008e-06 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896775+0000", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9190000000000002e-06 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.986971+0000", 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090196436000000005 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.986994+0000", 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2532999999999999e-05 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184440 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7083302449999991, 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090243996000000007, 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.661 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184440 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896819+0000", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896818+0000", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896834+0000", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5458999999999999e-05 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896844+0000", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0076e-05 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896851+0000", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.153e-06 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987050+0000", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090199451999999999 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987063+0000", 2024-09-21T13:59:43.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2699e-05 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184441 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7082562449999994, 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090259289000000006, 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.665 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184441 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896893+0000", 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896892+0000", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896896+0000", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8299999999999998e-06 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896905+0000", 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3030000000000005e-06 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.896912+0000", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9990000000000002e-06 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987130+0000", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090217836999999995 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.987152+0000", 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2215999999999999e-05 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184627 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7577600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6074113190000006, 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090278942000000001, 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184627 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997738+0000", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997737+0000", 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997741+0000", 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1870000000000001e-06 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997749+0000", 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2490000000000001e-06 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997755+0000", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3670000000000002e-06 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.087861+0000", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090105861999999995 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.087942+0000", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088017+0000", 2024-09-21T13:59:43.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5358999999999995e-05 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6073847899999993, 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T13:59:43.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T13:59:43.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T13:59:43.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.607361118, 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0018975530000001, 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:43.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T13:59:43.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:43.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:43.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:43.688 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:43.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:43.690 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:43.688+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:43.790 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:43.788+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:43.814 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:43.815 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:43.815 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:43.815 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:43.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:43.891 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:43.888+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:43.944 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:43.944 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:43.944 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:43.944 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:43.944 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:43.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:43.992 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:43.992+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:44.093 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:44.088+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:44.133 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:44.133 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:44.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191270 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10739712~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6491344420000003, 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082303901999999998, 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191270 2024-09-21T13:59:44.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481570+0000", 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481568+0000", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481575+0000", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2999999999999998e-06 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481612+0000", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7095000000000003e-05 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481626+0000", 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3983e-05 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563684+0000", 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082058255999999996 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563780+0000", 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5972999999999997e-05 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563874+0000", 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3725000000000001e-05 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191271 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10780672~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6490656540000002, 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082453983999999994, 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191271 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481639+0000", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481638+0000", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481644+0000", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6630000000000004e-06 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481661+0000", 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6546e-05 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481674+0000", 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3086e-05 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.563936+0000", 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082262440000000006 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564018+0000", 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1483000000000006e-05 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564093+0000", 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4826000000000005e-05 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6490184619999999, 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T13:59:44.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T13:59:44.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6489703540000002, 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.147 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T13:59:44.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6489081460000001, 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T13:59:44.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T13:59:44.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T13:59:44.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T13:59:44.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6488598970000004, 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T13:59:44.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6488145489999999, 2024-09-21T13:59:44.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T13:59:44.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T13:59:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6487680969999996, 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6487223179999999, 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.169 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6486772600000004, 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:44.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6486328009999998, 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6485804130000004, 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6485473299999995, 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T13:59:44.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6484624029999999, 2024-09-21T13:59:44.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T13:59:44.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6484153340000001, 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T13:59:44.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6483701389999998, 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:44.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6483125340000004, 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6468767450000001, 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.208 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6467986239999997, 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:44.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6467493720000004, 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T13:59:44.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.221 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.221 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:44.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:44.222 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:44.216+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:44.323 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:44.320+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:44.391 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:44.392 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:44.404 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:59:44.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:44.455 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:44.452+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:44.513 INFO:teuthology.orchestra.run.smithi079.stdout:4067 writesame 0xa04508d thru 0xa0536fd data_size 0x1f(0xe671 bytes) 2024-09-21T13:59:44.524 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:44.524+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:44.557 INFO:teuthology.orchestra.run.smithi079.stdout:4068 writesame 0xcb85335 thru 0xcb8b2ab data_size 0x1(0x5f77 bytes) 2024-09-21T13:59:44.559 INFO:teuthology.orchestra.run.smithi079.stdout:4069 write 0x6da256b thru 0x6daa029 (0x7abf bytes) 2024-09-21T13:59:44.578 INFO:teuthology.orchestra.run.smithi079.stdout:4071 clone 29 order 24 su 2097152 sc 11 2024-09-21T13:59:44.585 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:44.586 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:44.586 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:44.586 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:44.586 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:44.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:44.625 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:44.624+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:44.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:44.724+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:44.726 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:44.726 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.847444125999999, 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:44.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.839566963000003, 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:44.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835629941000001, 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835618732, 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:44.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:44.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.745 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.83560756, 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835593256999999, 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835557797, 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835544634000001, 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:44.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:44.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.835533103000003, 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831545134999999, 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:44.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:44.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831525503000002, 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:44.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:44.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831500675000001, 2024-09-21T13:59:44.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:44.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831475677999997, 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:44.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831463608, 2024-09-21T13:59:44.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:44.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:44.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831452288000001, 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:44.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:44.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831441147, 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:44.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.798 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831428846000001, 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:44.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:44.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.831417594000001, 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:44.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:44.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.755347841999999, 2024-09-21T13:59:44.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:44.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:44.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.746121266000003, 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:44.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:44.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:44.817 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:44.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:44.868 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:44.868+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:44.927 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:44.928+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:44.950 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:44.950 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:44.950 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:44.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:45.056 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:45.056+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:45.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:45.133 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:45.133 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:45.134 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:45.132+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:45.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:45.235 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:45.236+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:45.267 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:45.267 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:45.284 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:45.284 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:45.301 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:45.302 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:45.311 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:45.311 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:45.318 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:45.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:45.332 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:45.328+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:45.338 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:45.339 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:45.359 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:45.360 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:45.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:45.380 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:45.383 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:45.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:45.444 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:45.428+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:45.460 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:45.460 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:45.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:45.534 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:45.528+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:45.546 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone28 from 0xcb8b2ac (overlap 0xba29453) to 0x0 2024-09-21T13:59:45.614 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:45.614 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:45.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:45.634 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:45.628+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:45.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:45.736+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:45.744 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:45.744 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:45.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:45.844 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:45.844+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:45.916 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:45.916 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:45.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:45.939 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:45.936+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:46.042 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:46.040+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:46.090 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.091 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:46.151 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:46.152+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:46.222 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.222 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:46.242 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:46.236+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:46.343 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:46.340+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:46.395 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.395 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:46.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:59:46.443 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:46.440+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:46.544 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:46.544+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:46.550 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.550 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:46.580 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-21T13:59:46.645 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:46.640+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:46.705 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.706 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:46.767 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:46.764+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:46.846 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:46.840+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:46.851 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:46.852 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:46.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:46.912 INFO:teuthology.orchestra.run.smithi079.stdout:4072 write 0x74f5c30 thru 0x7500c29 (0xaffa bytes) 2024-09-21T13:59:46.947 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:46.944+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:46.952 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:46.952 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:46.952 INFO:teuthology.orchestra.run.smithi079.stdout:4076 punch from 0x3335d21 to 0x3341568, (0xb847 bytes) 2024-09-21T13:59:46.959 INFO:teuthology.orchestra.run.smithi079.stdout:4077 trunc from 0xcb8b2ac to 0x8139eb3 2024-09-21T13:59:47.048 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:47.048+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:47.065 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:47.065 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:47.075 INFO:teuthology.orchestra.run.smithi079.stdout:4079 read 0x7d38a43 thru 0x7d3f924 (0x6ee2 bytes) 2024-09-21T13:59:47.076 INFO:teuthology.orchestra.run.smithi079.stdout:4080 punch from 0x3277c7d to 0x327a259, (0x25dc bytes) 2024-09-21T13:59:47.076 INFO:teuthology.orchestra.run.smithi079.stdout:4082 read 0x43e9f5 thru 0x44b5cb (0xcbd7 bytes) 2024-09-21T13:59:47.077 INFO:teuthology.orchestra.run.smithi079.stdout:4083 clone 30 order 19 su 4096 sc 11 2024-09-21T13:59:47.080 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:47.149 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:47.148+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:47.194 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:47.194 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:47.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:47.249 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:47.248+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:47.324 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:47.324 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:47.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:47.350 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:47.348+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:47.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:47.407 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7, 1] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:47.407 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:47.407 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 2, 3, 4, 5, 6, 7, 1] 2024-09-21T13:59:47.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-21T13:59:47.444 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:59:47.445 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:47.451 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:47.448+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:47.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:47.531 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone29 intact 2024-09-21T13:59:47.545 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:47.545 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:47.551 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:47.552+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:47.562 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:47.562 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:47.593 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:47.593 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:47.611 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:47.611 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:47.620 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:47.621 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:47.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:47.644 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:47.644 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:47.662 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:47.663 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:47.669 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-21T13:59:47.679 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:47.676+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:47.680 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:47.681 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:47.681 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:47.685 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:47.685 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:47.686 INFO:teuthology.orchestra.run.smithi079.stdout:4084 write 0xc37a9d2 thru 0xc37e6e0 (0x3d0f bytes) 2024-09-21T13:59:47.695 INFO:teuthology.orchestra.run.smithi079.stdout:4085 write 0x82a8a8d thru 0x82b147f (0x89f3 bytes) 2024-09-21T13:59:47.753 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:47.748+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:47.774 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:47.774 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:47.774 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:47.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:47.791 INFO:teuthology.orchestra.run.smithi079.stdout:4086 punch from 0x78406dd to 0x7847449, (0x6d6c bytes) 2024-09-21T13:59:47.791 INFO:teuthology.orchestra.run.smithi079.stdout:4087 read 0x8d6d557 thru 0x8d7a4da (0xcf84 bytes) 2024-09-21T13:59:47.791 INFO:teuthology.orchestra.run.smithi079.stdout:4088 punch from 0x7fd0d3f to 0x7fdf3de, (0xe69f bytes) 2024-09-21T13:59:47.791 INFO:teuthology.orchestra.run.smithi079.stdout:4090 write 0xabc6bc1 thru 0xabcfd39 (0x9179 bytes) 2024-09-21T13:59:47.795 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T13:59:47.796+0000 7f74c16a6640 -1 mon.a@0(leader).osd e88 definitely_dead 0 2024-09-21T13:59:47.804 INFO:teuthology.orchestra.run.smithi079.stdout:4091 read 0x8cc76f9 thru 0x8cd71b4 (0xfabc bytes) 2024-09-21T13:59:47.804 INFO:teuthology.orchestra.run.smithi079.stdout:4092 writesame 0xfd917c thru 0xfdb817 data_size 0xe(0x269c bytes) 2024-09-21T13:59:47.854 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:47.852+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:47.885 INFO:teuthology.orchestra.run.smithi079.stdout:4093 read 0x41e38d0 thru 0x41ebaa9 (0x81da bytes) 2024-09-21T13:59:47.887 INFO:teuthology.orchestra.run.smithi079.stdout:4095 write 0x559394 thru 0x55a865 (0x14d2 bytes) 2024-09-21T13:59:47.928 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:47.928 INFO:teuthology.orchestra.run.smithi079.stdout:4099 write 0xb1593da thru 0xb167348 (0xdf6f bytes) 2024-09-21T13:59:47.944 INFO:teuthology.orchestra.run.smithi079.stdout:4100 write 0x9c0c7d thru 0x9c297a (0x1cfe bytes) 2024-09-21T13:59:47.954 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:47.952+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:47.974 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:47.974 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:47.975 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:47.975 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:47.989 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:48.042 INFO:teuthology.orchestra.run.smithi079.stdout:4101 writesame 0xa93278a thru 0xa938f7f data_size 0x7(0x67f6 bytes) 2024-09-21T13:59:48.055 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:48.056+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:48.057 INFO:teuthology.orchestra.run.smithi079.stdout:4102 punch from 0x7be514a to 0x7bf5017, (0xfecd bytes) 2024-09-21T13:59:48.057 INFO:teuthology.orchestra.run.smithi079.stdout:4103 write 0xbdc4dcb thru 0xbdc65e7 (0x181d bytes) 2024-09-21T13:59:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:4104 writesame 0xc5a60aa thru 0xc5a81e4 data_size 0x1(0x213b bytes) 2024-09-21T13:59:48.080 INFO:teuthology.orchestra.run.smithi079.stdout:4106 trunc from 0xc5a81e5 to 0x9ed455c 2024-09-21T13:59:48.113 INFO:teuthology.orchestra.run.smithi079.stdout:4107 write 0x606e9b1 thru 0x607c851 (0xdea1 bytes) 2024-09-21T13:59:48.121 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:48.121 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:48.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:48.121 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.243204953999999, 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:48.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T13:59:48.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.235327791000003, 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T13:59:48.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T13:59:48.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231390769000001, 2024-09-21T13:59:48.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231379560000001, 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T13:59:48.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231368388, 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T13:59:48.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T13:59:48.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231354085, 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T13:59:48.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231318625, 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.147 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T13:59:48.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231305462000002, 2024-09-21T13:59:48.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:48.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T13:59:48.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.231293931000003, 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227305962999999, 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:48.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227286331000002, 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T13:59:48.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227261503000001, 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T13:59:48.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T13:59:48.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227236505999997, 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T13:59:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T13:59:48.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227224436, 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T13:59:48.182 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227213116000001, 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.183 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227201975, 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227189674000002, 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T13:59:48.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:48.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T13:59:48.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.227178422000001, 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T13:59:48.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T13:59:48.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.151108669999999, 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T13:59:48.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T13:59:48.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T13:59:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.141882094000003, 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T13:59:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:48.209 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:48.209 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:48.210 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:48.204+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:48.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:48.279 INFO:teuthology.orchestra.run.smithi079.stdout:4108 read 0x4c333f5 thru 0x4c42558 (0xf164 bytes) 2024-09-21T13:59:48.289 INFO:teuthology.orchestra.run.smithi079.stdout:4109 read 0x61badca thru 0x61c4aa7 (0x9cde bytes) 2024-09-21T13:59:48.290 INFO:teuthology.orchestra.run.smithi079.stdout:4110 write 0x5d5cec1 thru 0x5d68c8f (0xbdcf bytes) 2024-09-21T13:59:48.310 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:48.308+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:48.365 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:48.366 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:48.366 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:48.366 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:48.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:48.411 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:48.408+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:48.443 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.2. 2024-09-21T13:59:48.512 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:48.512+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:48.549 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:48.549 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:48.549 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:48.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:48.652 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:48.652+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:48.715 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:48.712+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:48.741 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:48.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.131838668, 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:48.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:48.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126370 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 30720~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200354685999997, 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050926705000000003, 2024-09-21T13:59:48.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126370 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537537+0000", 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537536+0000", 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537538+0000", 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0899999999999999e-06 2024-09-21T13:59:48.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537544+0000", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4689999999999996e-06 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537548+0000", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588328+0000", 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050779457 2024-09-21T13:59:48.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588384+0000", 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6156999999999998e-05 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588463+0000", 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9390999999999999e-05 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.751 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126371 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 51200~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200339165999999, 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051068768, 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126371 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537552+0000", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537554+0000", 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9719999999999999e-06 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537559+0000", 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5130000000000004e-06 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537564+0000", 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4399999999999998e-06 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588488+0000", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050924687000000003 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588551+0000", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2268999999999996e-05 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588621+0000", 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0227000000000004e-05 2024-09-21T13:59:48.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126372 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 71680~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200323951999998, 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051259907, 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.756 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126372 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537567+0000", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537569+0000", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9910000000000001e-06 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537575+0000", 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7570000000000001e-06 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537579+0000", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3649999999999997e-06 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588646+0000", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051067250000000002 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588712+0000", 2024-09-21T13:59:48.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5172000000000006e-05 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588827+0000", 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011572 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126373 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 118784~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200308053000001, 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051569028000000003, 2024-09-21T13:59:48.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126373 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537583+0000", 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537585+0000", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.852e-06 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537591+0000", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.728e-06 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537595+0000", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4560000000000002e-06 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588853+0000", 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051257748999999998 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.588909+0000", 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6140000000000001e-05 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589152+0000", 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000243432 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200292928000003, 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200277560000004, 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.769 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:48.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200262410000001, 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:48.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.777 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.200226897, 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:48.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141003 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.854556889000001, 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051137289000000002, 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141003 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883334+0000", 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883336+0000", 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883344+0000", 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-06 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883349+0000", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8250000000000004e-06 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934156+0000", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.050807057000000003 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934234+0000", 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7729000000000001e-05 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934472+0000", 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023826899999999999 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141004 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 451584~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.854538460000001, 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.05147119, 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141004 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883353+0000", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883355+0000", 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2340000000000001e-06 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883362+0000", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4189999999999996e-06 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883367+0000", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1680000000000003e-06 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934501+0000", 2024-09-21T13:59:48.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051133396999999997 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934579+0000", 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7818999999999995e-05 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934824+0000", 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024550599999999999 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.791 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.792 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:48.792 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.854519891999999, 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.793 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:48.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.184497252, 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T13:59:48.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T13:59:48.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.183169542000002, 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T13:59:48.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T13:59:48.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T13:59:48.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T13:59:48.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T13:59:48.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3389886710000001, 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.811 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3389171470000001, 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T13:59:48.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T13:59:48.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T13:59:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3388216249999996, 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T13:59:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3387655269999996, 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T13:59:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3387299969999997, 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T13:59:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T13:59:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3387048779999997, 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T13:59:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T13:59:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T13:59:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:48.841 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:48.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:48.843 INFO:teuthology.orchestra.run.smithi079.stdout:4111 write 0xbf5728e thru 0xbf5de12 (0x6b85 bytes) 2024-09-21T13:59:48.843 INFO:teuthology.orchestra.run.smithi079.stdout:4112 write 0x726fb1c thru 0x726fe92 (0x377 bytes) 2024-09-21T13:59:48.844 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:48.840+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:48.851 INFO:teuthology.orchestra.run.smithi079.stdout:4113 punch from 0xcb35bc to 0xcb3bb7, (0x5fb bytes) 2024-09-21T13:59:48.851 INFO:teuthology.orchestra.run.smithi079.stdout:4114 write 0x30c9fa9 thru 0x30d6dd6 (0xce2e bytes) 2024-09-21T13:59:48.944 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:48.940+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:48.989 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:48.989 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:48.989 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:48.989 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:49.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:49.051 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:49.052+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:49.130 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:49.130 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:49.130 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:49.145 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:49.144+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:49.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:4116 read 0xaf31e6f thru 0xaf3bab0 (0x9c42 bytes) 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:4118 punch from 0x6db0a4e to 0x6db50a6, (0x4658 bytes) 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:4127 punch from 0xa9957c9 to 0xa9a2260, (0xca97 bytes) 2024-09-21T13:59:49.180 INFO:teuthology.orchestra.run.smithi079.stdout:4128 write 0x7474343 thru 0x747e1fa (0x9eb8 bytes) 2024-09-21T13:59:49.245 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:49.244+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.484755234999994, 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:49.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:49.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:49.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:49.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.344731795000001, 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:49.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:49.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:49.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:49.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.316472790000006, 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:49.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.419364244999997, 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:49.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.419302775999995, 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.345 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:49.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:49.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3410 3.4 3:24c2c2cc:::rbd_data.1185f0a8fe85.0000000000000001:4 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.411132026000004, 2024-09-21T13:59:49.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080417049999999997, 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3410 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909387+0000", 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909386+0000", 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909389+0000", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8949999999999998e-06 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909396+0000", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8689999999999998e-06 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909401+0000", 2024-09-21T13:59:49.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7090000000000001e-06 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914036+0000", 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046357569999999999 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.914130+0000", 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3158000000000005e-05 2024-09-21T13:59:49.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.917429+0000", 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988879999999998 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410238801000006, 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:49.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:49.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410181041000001, 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:49.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.364 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410162448999998, 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:49.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:49.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:49.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410150110999993, 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:49.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410128374999999, 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:49.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410105192000003, 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.379 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:49.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410084763, 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.384 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:49.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:49.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410069965000005, 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:49.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410045381000003, 2024-09-21T13:59:49.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410028685, 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:49.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 76.410006448000004, 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:49.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:49.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.491718144999993, 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:49.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.322199596999994, 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:49.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:49.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:49.419 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.958961002999999, 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:49.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:49.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:49.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:49.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:49.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:49.426 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:49.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:49.428 INFO:teuthology.orchestra.run.smithi079.stdout:4129 read 0x2d2ba69 thru 0x2d37de3 (0xc37b bytes) 2024-09-21T13:59:49.428 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:49.428 INFO:teuthology.orchestra.run.smithi079.stdout:4131 write 0x190df0f thru 0x191349e (0x5590 bytes) 2024-09-21T13:59:49.428 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:49.424+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:49.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T13:59:49.485 INFO:teuthology.orchestra.run.smithi079.stdout:4133 write 0x42b802 thru 0x4343e2 (0x8be1 bytes) 2024-09-21T13:59:49.528 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:49.524+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:49.617 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:49.617 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:49.617 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:49.617 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:49.629 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:49.628+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:49.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:49.638 INFO:teuthology.orchestra.run.smithi079.stdout:4134 trunc from 0xbf5de13 to 0x6af7573 2024-09-21T13:59:49.686 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:49.731 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:49.732+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:49.796 INFO:teuthology.orchestra.run.smithi079.stdout:4135 writesame 0x75d2748 thru 0x75e04bb data_size 0x2(0xdd74 bytes) 2024-09-21T13:59:49.796 INFO:teuthology.orchestra.run.smithi079.stdout:4136 punch from 0x515604c to 0x515adf5, (0x4da9 bytes) 2024-09-21T13:59:49.796 INFO:teuthology.orchestra.run.smithi079.stdout:4143 read 0x6706456 thru 0x6715b6f (0xf71a bytes) 2024-09-21T13:59:49.802 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:49.803 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:49.803 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:49.803 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:49.803 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:49.804 INFO:teuthology.orchestra.run.smithi079.stdout:4144 trunc from 0x75e04bc to 0x51cef33 2024-09-21T13:59:49.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:49.864 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:49.864+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:49.871 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:49.871 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:49.896 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:49.896 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:49.914 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:49.914 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:49.930 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:49.931 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:49.931 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:49.928+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:49.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:49.950 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:49.987 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:49.987 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.007 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:50.007 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:50.008 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:50.024 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:50.025 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:50.028 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:50.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:50.045 INFO:teuthology.orchestra.run.smithi079.stdout:4145 trunc from 0x51cef33 to 0xecf7de6 2024-09-21T13:59:50.046 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:50.044+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:50.052 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.052 INFO:teuthology.orchestra.run.smithi079.stdout:4147 write 0x9f9a3c9 thru 0x9f9c190 (0x1dc8 bytes) 2024-09-21T13:59:50.079 INFO:teuthology.orchestra.run.smithi079.stdout:4148 trunc from 0xecf7de6 to 0xa25ac4 2024-09-21T13:59:50.132 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:50.132+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:50.169 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:50.169 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:50.234 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:50.228+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:50.250 INFO:teuthology.orchestra.run.smithi079.stdout:4149 trunc from 0xa25ac4 to 0xeccf05c 2024-09-21T13:59:50.266 INFO:teuthology.orchestra.run.smithi079.stdout:4150 trunc from 0xeccf05c to 0xb717f54 2024-09-21T13:59:50.292 INFO:teuthology.orchestra.run.smithi079.stdout:4151 trunc from 0xb717f54 to 0x1c5c005 2024-09-21T13:59:50.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:50.332+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:50.337 INFO:teuthology.orchestra.run.smithi079.stdout:4152 writesame 0xe427545 thru 0xe42a2e4 data_size 0x1(0x2da0 bytes) 2024-09-21T13:59:50.338 INFO:teuthology.orchestra.run.smithi079.stdout:4153 read 0xcb1ca7c thru 0xcb209c2 (0x3f47 bytes) 2024-09-21T13:59:50.338 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.338 INFO:teuthology.orchestra.run.smithi079.stdout:4157 writesame 0x7a92b6a thru 0x7a9e7f9 data_size 0x38(0xbc90 bytes) 2024-09-21T13:59:50.357 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:50.357 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.367 INFO:teuthology.orchestra.run.smithi079.stdout:4158 read 0x76600df thru 0x7668afb (0x8a1d bytes) 2024-09-21T13:59:50.367 INFO:teuthology.orchestra.run.smithi079.stdout:4161 write 0x9926fab thru 0x9928106 (0x115c bytes) 2024-09-21T13:59:50.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:50.376 INFO:teuthology.orchestra.run.smithi079.stdout:4163 write 0x835c7a5 thru 0x83634e4 (0x6d40 bytes) 2024-09-21T13:59:50.397 INFO:teuthology.orchestra.run.smithi079.stdout:4164 read 0x2f4afaf thru 0x2f4fa0a (0x4a5c bytes) 2024-09-21T13:59:50.398 INFO:teuthology.orchestra.run.smithi079.stdout:4168 writesame 0xda324e thru 0xdb188e data_size 0x1(0xe641 bytes) 2024-09-21T13:59:50.437 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:50.432+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:50.446 INFO:teuthology.orchestra.run.smithi079.stdout:4169 trunc from 0xe42a2e5 to 0x8642379 2024-09-21T13:59:50.457 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T13:59:50.477 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.477 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.477 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.497 INFO:teuthology.orchestra.run.smithi079.stdout:4176 writesame 0xd9b28ac thru 0xd9ba670 data_size 0x1(0x7dc5 bytes) 2024-09-21T13:59:50.497 INFO:teuthology.orchestra.run.smithi079.stdout:4179 punch from 0xa847bf4 to 0xa853d4e, (0xc15a bytes) 2024-09-21T13:59:50.497 INFO:teuthology.orchestra.run.smithi079.stdout:4180 read 0x1656864 thru 0x1657549 (0xce6 bytes) 2024-09-21T13:59:50.511 INFO:teuthology.orchestra.run.smithi079.stdout:4182 trunc from 0xd9ba671 to 0x490df20 2024-09-21T13:59:50.525 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:50.525 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.537 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:50.536+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:50.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:50.539 INFO:teuthology.orchestra.run.smithi079.stdout:4183 punch from 0x32de1fb to 0x32eabcb, (0xc9d0 bytes) 2024-09-21T13:59:50.539 INFO:teuthology.orchestra.run.smithi079.stdout:4184 punch from 0x1b4abb5 to 0x1b50413, (0x585e bytes) 2024-09-21T13:59:50.550 INFO:teuthology.orchestra.run.smithi079.stdout:4185 trunc from 0x490df20 to 0xd0a55d4 2024-09-21T13:59:50.559 INFO:teuthology.orchestra.run.smithi079.stdout:4186 write 0x1a2b3d thru 0x1a5928 (0x2dec bytes) 2024-09-21T13:59:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:4187 read 0x34b080f thru 0x34b13bc (0xbae bytes) 2024-09-21T13:59:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:4188 write 0x4cf7506 thru 0x4cfdec0 (0x69bb bytes) 2024-09-21T13:59:50.573 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.574 INFO:teuthology.orchestra.run.smithi079.stdout:4192 writesame 0xc087613 thru 0xc090378 data_size 0x9(0x8d66 bytes) 2024-09-21T13:59:50.593 INFO:teuthology.orchestra.run.smithi079.stdout:4193 trunc from 0xd0a55d4 to 0xb168ffd 2024-09-21T13:59:50.609 INFO:teuthology.orchestra.run.smithi079.stdout:4194 writesame 0x8018a7f thru 0x8027fc5 data_size 0x1(0xf547 bytes) 2024-09-21T13:59:50.633 INFO:teuthology.orchestra.run.smithi079.stdout:4197 punch from 0x91d358d to 0x91dd4be, (0x9f31 bytes) 2024-09-21T13:59:50.633 INFO:teuthology.orchestra.run.smithi079.stdout:4198 write 0xb98049 thru 0xba0872 (0x882a bytes) 2024-09-21T13:59:50.636 INFO:teuthology.orchestra.run.smithi079.stdout:4200 read 0x72dce36 thru 0x72e2e64 (0x602f bytes) 2024-09-21T13:59:50.636 INFO:teuthology.orchestra.run.smithi079.stdout:4201 read 0x1fa7bee thru 0x1faf27c (0x768f bytes) 2024-09-21T13:59:50.636 INFO:teuthology.orchestra.run.smithi079.stdout:4202 write 0x703df7f thru 0x7046bcd (0x8c4f bytes) 2024-09-21T13:59:50.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:50.636+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:50.654 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.654 INFO:teuthology.orchestra.run.smithi079.stdout:4204 read 0x2c776d6 thru 0x2c7a4b6 (0x2de1 bytes) 2024-09-21T13:59:50.654 INFO:teuthology.orchestra.run.smithi079.stdout:4205 writesame 0x6ba7aa2 thru 0x6baf056 data_size 0x1(0x75b5 bytes) 2024-09-21T13:59:50.676 INFO:teuthology.orchestra.run.smithi079.stdout:4206 read 0x8fcb07e thru 0x8fd2495 (0x7418 bytes) 2024-09-21T13:59:50.676 INFO:teuthology.orchestra.run.smithi079.stdout:4208 read 0x2604443 thru 0x2606862 (0x2420 bytes) 2024-09-21T13:59:50.689 INFO:teuthology.orchestra.run.smithi079.stdout:4209 write 0xdd38f73 thru 0xdd4627f (0xd30d bytes) 2024-09-21T13:59:50.693 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:50.693 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:50.725 INFO:teuthology.orchestra.run.smithi079.stdout:4211 trunc from 0xdd46280 to 0xffe206 2024-09-21T13:59:50.740 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:50.740+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:50.774 INFO:teuthology.orchestra.run.smithi079.stdout:4212 write 0x58b6bd0 thru 0x58c161b (0xaa4c bytes) 2024-09-21T13:59:50.793 INFO:teuthology.orchestra.run.smithi079.stdout:4213 trunc from 0x58c161c to 0x740915a 2024-09-21T13:59:50.805 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.805 INFO:teuthology.orchestra.run.smithi079.stdout:4216 read 0x4fb398a thru 0x4fc113a (0xd7b1 bytes) 2024-09-21T13:59:50.825 INFO:teuthology.orchestra.run.smithi079.stdout:4217 writesame 0xa8a2a36 thru 0xa8aa7db data_size 0x9(0x7da6 bytes) 2024-09-21T13:59:50.825 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.825 INFO:teuthology.orchestra.run.smithi079.stdout:4222 read 0x21f92cc thru 0x2200490 (0x71c5 bytes) 2024-09-21T13:59:50.841 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:50.836+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:50.842 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:50.842 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:50.846 INFO:teuthology.orchestra.run.smithi079.stdout:4223 writesame 0xe9dae98 thru 0xe9db13d data_size 0x3(0x2a6 bytes) 2024-09-21T13:59:50.847 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.847 INFO:teuthology.orchestra.run.smithi079.stdout:4225 read 0x78ac10a thru 0x78af527 (0x341e bytes) 2024-09-21T13:59:50.847 INFO:teuthology.orchestra.run.smithi079.stdout:4226 write 0xb558afd thru 0xb55ac4c (0x2150 bytes) 2024-09-21T13:59:50.856 INFO:teuthology.orchestra.run.smithi079.stdout:4227 writesame 0x97cc779 thru 0x97d0e47 data_size 0x1(0x46cf bytes) 2024-09-21T13:59:50.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:50.887 INFO:teuthology.orchestra.run.smithi079.stdout:4229 write 0xed0a53a thru 0xed16410 (0xbed7 bytes) 2024-09-21T13:59:50.904 INFO:teuthology.orchestra.run.smithi079.stdout:4231 punch from 0xedff54 to 0xeeaedf, (0xaf8b bytes) 2024-09-21T13:59:50.905 INFO:teuthology.orchestra.run.smithi079.stdout:4232 write 0x69bce30 thru 0x69c09ce (0x3b9f bytes) 2024-09-21T13:59:50.916 INFO:teuthology.orchestra.run.smithi079.stdout:4233 writesame 0xe61d25d thru 0xe622de3 data_size 0x1(0x5b87 bytes) 2024-09-21T13:59:50.933 INFO:teuthology.orchestra.run.smithi079.stdout:4234 writesame 0x13f9594 thru 0x1408f73 data_size 0x10(0xf9e0 bytes) 2024-09-21T13:59:50.942 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:50.940+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:4236 punch from 0xb10b2b0 to 0xb11aa38, (0xf788 bytes) 2024-09-21T13:59:50.954 INFO:teuthology.orchestra.run.smithi079.stdout:4237 write 0xc2f0a9c thru 0xc2fda8e (0xcff3 bytes) 2024-09-21T13:59:50.974 INFO:teuthology.orchestra.run.smithi079.stdout:4238 read 0x20880b0 thru 0x208ffc3 (0x7f14 bytes) 2024-09-21T13:59:50.974 INFO:teuthology.orchestra.run.smithi079.stdout:4241 read 0xa3c15fe thru 0xa3cdedc (0xc8df bytes) 2024-09-21T13:59:50.975 INFO:teuthology.orchestra.run.smithi079.stdout:4242 read 0x7872f0b thru 0x78809f6 (0xdaec bytes) 2024-09-21T13:59:50.975 INFO:teuthology.orchestra.run.smithi079.stdout:4244 read 0x890f7a5 thru 0x891f068 (0xf8c4 bytes) 2024-09-21T13:59:50.975 INFO:teuthology.orchestra.run.smithi079.stdout:4245 write 0x41b210e thru 0x41be400 (0xc2f3 bytes) 2024-09-21T13:59:50.990 INFO:teuthology.orchestra.run.smithi079.stdout:4247 write 0x3aabed7 thru 0x3aaf5ad (0x36d7 bytes) 2024-09-21T13:59:51.001 INFO:teuthology.orchestra.run.smithi079.stdout:4248 write 0x5893e0 thru 0x595adb (0xc6fc bytes) 2024-09-21T13:59:51.008 INFO:teuthology.orchestra.run.smithi079.stdout:4249 write 0x77a8896 thru 0x77aff72 (0x76dd bytes) 2024-09-21T13:59:51.023 INFO:teuthology.orchestra.run.smithi079.stdout:4250 writesame 0x6e7357e thru 0x6e7d73d data_size 0x20(0xa1c0 bytes) 2024-09-21T13:59:51.042 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.042 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.043 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:51.036+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:51.043 INFO:teuthology.orchestra.run.smithi079.stdout:4252 punch from 0xa751b8d to 0xa75fd50, (0xe1c3 bytes) 2024-09-21T13:59:51.043 INFO:teuthology.orchestra.run.smithi079.stdout:4254 punch from 0x4310def to 0x4316c7f, (0x5e90 bytes) 2024-09-21T13:59:51.043 INFO:teuthology.orchestra.run.smithi079.stdout:4256 read 0x2eacdf3 thru 0x2eb9208 (0xc416 bytes) 2024-09-21T13:59:51.043 INFO:teuthology.orchestra.run.smithi079.stdout:4257 writesame 0xa25d8cb thru 0xa267704 data_size 0x56(0x9e3a bytes) 2024-09-21T13:59:51.058 INFO:teuthology.orchestra.run.smithi079.stdout:4258 read 0x783e0db thru 0x78430e1 (0x5007 bytes) 2024-09-21T13:59:51.059 INFO:teuthology.orchestra.run.smithi079.stdout:4259 write 0x2b8557f thru 0x2b90687 (0xb109 bytes) 2024-09-21T13:59:51.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:51.072 INFO:teuthology.orchestra.run.smithi079.stdout:4260 read 0x77aace6 thru 0x77b5319 (0xa634 bytes) 2024-09-21T13:59:51.074 INFO:teuthology.orchestra.run.smithi079.stdout:4261 writesame 0x7b3a6b4 thru 0x7b444b3 data_size 0x4f(0x9e00 bytes) 2024-09-21T13:59:51.089 INFO:teuthology.orchestra.run.smithi079.stdout:4262 read 0xd5ec69f thru 0xd5fa99f (0xe301 bytes) 2024-09-21T13:59:51.089 INFO:teuthology.orchestra.run.smithi079.stdout:4263 read 0xed05332 thru 0xed0bd16 (0x69e5 bytes) 2024-09-21T13:59:51.089 INFO:teuthology.orchestra.run.smithi079.stdout:4267 write 0x1b812aa thru 0x1b8a98c (0x96e3 bytes) 2024-09-21T13:59:51.102 INFO:teuthology.orchestra.run.smithi079.stdout:4268 write 0x4306d54 thru 0x4309921 (0x2bce bytes) 2024-09-21T13:59:51.136 INFO:teuthology.orchestra.run.smithi079.stdout:4269 trunc from 0xed16411 to 0xee89df 2024-09-21T13:59:51.147 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:51.144+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:51.191 INFO:teuthology.orchestra.run.smithi079.stdout:4270 read 0x956841 thru 0x961af0 (0xb2b0 bytes) 2024-09-21T13:59:51.208 INFO:teuthology.orchestra.run.smithi079.stdout:4272 write 0x4b2cb3f thru 0x4b3b06f (0xe531 bytes) 2024-09-21T13:59:51.225 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.236 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.237 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.244 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:51.240+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:51.248 INFO:teuthology.orchestra.run.smithi079.stdout:4275 writesame 0xa75af49 thru 0xa767b59 data_size 0x11(0xcc11 bytes) 2024-09-21T13:59:51.248 INFO:teuthology.orchestra.run.smithi079.stdout:4276 punch from 0x77bb95a to 0x77c776f, (0xbe15 bytes) 2024-09-21T13:59:51.248 INFO:teuthology.orchestra.run.smithi079.stdout:4277 writesame 0x631c9fe thru 0x6322214 data_size 0x1(0x5817 bytes) 2024-09-21T13:59:51.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:51.269 INFO:teuthology.orchestra.run.smithi079.stdout:4281 writesame 0x988eff1 thru 0x98906e1 data_size 0x1(0x16f1 bytes) 2024-09-21T13:59:51.281 INFO:teuthology.orchestra.run.smithi079.stdout:4283 writesame 0x76965cb thru 0x769a343 data_size 0x1(0x3d79 bytes) 2024-09-21T13:59:51.297 INFO:teuthology.orchestra.run.smithi079.stdout:4285 writesame 0x5a8feb7 thru 0x5a9ca95 data_size 0x9(0xcbdf bytes) 2024-09-21T13:59:51.318 INFO:teuthology.orchestra.run.smithi079.stdout:4286 read 0x64d15a4 thru 0x64dae5d (0x98ba bytes) 2024-09-21T13:59:51.319 INFO:teuthology.orchestra.run.smithi079.stdout:4288 punch from 0x77d0945 to 0x77d7f29, (0x75e4 bytes) 2024-09-21T13:59:51.319 INFO:teuthology.orchestra.run.smithi079.stdout:4289 writesame 0xdb9aba thru 0xdbf97e data_size 0x1(0x5ec5 bytes) 2024-09-21T13:59:51.329 INFO:teuthology.orchestra.run.smithi079.stdout:4291 read 0x513809d thru 0x513e0a7 (0x600b bytes) 2024-09-21T13:59:51.329 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.329 INFO:teuthology.orchestra.run.smithi079.stdout:4293 write 0x9522c thru 0x96d35 (0x1b0a bytes) 2024-09-21T13:59:51.332 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.332 INFO:teuthology.orchestra.run.smithi079.stdout:4297 punch from 0x8b64f93 to 0x8b6a678, (0x56e5 bytes) 2024-09-21T13:59:51.332 INFO:teuthology.orchestra.run.smithi079.stdout:4299 read 0x733b59 thru 0x7421c2 (0xe66a bytes) 2024-09-21T13:59:51.334 INFO:teuthology.orchestra.run.smithi079.stdout:4300 read 0x5e56812 thru 0x5e58b0a (0x22f9 bytes) 2024-09-21T13:59:51.334 INFO:teuthology.orchestra.run.smithi079.stdout:4301 punch from 0x2354a95 to 0x23602c1, (0xb82c bytes) 2024-09-21T13:59:51.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:51.344+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:51.353 INFO:teuthology.orchestra.run.smithi079.stdout:4302 writesame 0xe2da0f8 thru 0xe2db771 data_size 0x15(0x167a bytes) 2024-09-21T13:59:51.353 INFO:teuthology.orchestra.run.smithi079.stdout:4303 read 0xaf95724 thru 0xaf991d7 (0x3ab4 bytes) 2024-09-21T13:59:51.353 INFO:teuthology.orchestra.run.smithi079.stdout:4304 write 0x2fd77e9 thru 0x2fe0999 (0x91b1 bytes) 2024-09-21T13:59:51.376 INFO:teuthology.orchestra.run.smithi079.stdout:4305 trunc from 0xe2db772 to 0xbbde470 2024-09-21T13:59:51.387 INFO:teuthology.orchestra.run.smithi079.stdout:4306 read 0x7e32fd5 thru 0x7e3c9cf (0x99fb bytes) 2024-09-21T13:59:51.406 INFO:teuthology.orchestra.run.smithi079.stdout:4307 write 0xe9fd598 thru 0xea03cc4 (0x672d bytes) 2024-09-21T13:59:51.428 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.428 INFO:teuthology.orchestra.run.smithi079.stdout:4311 punch from 0xb27c427 to 0xb287b49, (0xb722 bytes) 2024-09-21T13:59:51.428 INFO:teuthology.orchestra.run.smithi079.stdout:4314 read 0x7c5a089 thru 0x7c5b56c (0x14e4 bytes) 2024-09-21T13:59:51.428 INFO:teuthology.orchestra.run.smithi079.stdout:4315 writesame 0x8d7a6b5 thru 0x8d7a856 data_size 0x13(0x1a2 bytes) 2024-09-21T13:59:51.429 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.429 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.433 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.433 INFO:teuthology.orchestra.run.smithi079.stdout:4318 write 0xa272ba5 thru 0xa27ab57 (0x7fb3 bytes) 2024-09-21T13:59:51.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:51.446 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:51.440+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:51.452 INFO:teuthology.orchestra.run.smithi079.stdout:4320 read 0x3289d84 thru 0x3293484 (0x9701 bytes) 2024-09-21T13:59:51.473 INFO:teuthology.orchestra.run.smithi079.stdout:4321 trunc from 0xea03cc5 to 0x5883fa9 2024-09-21T13:59:51.526 INFO:teuthology.orchestra.run.smithi079.stdout:4322 writesame 0x9e5ad17 thru 0x9e64ced data_size 0x1d(0x9fd7 bytes) 2024-09-21T13:59:51.526 INFO:teuthology.orchestra.run.smithi079.stdout:4325 writesame 0x77e4d7f thru 0x77f258e data_size 0x8(0xd810 bytes) 2024-09-21T13:59:51.547 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:51.548+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:4327 read 0x5a1fcca thru 0x5a20951 (0xc88 bytes) 2024-09-21T13:59:51.560 INFO:teuthology.orchestra.run.smithi079.stdout:4328 write 0xa1c22c0 thru 0xa1cdc82 (0xb9c3 bytes) 2024-09-21T13:59:51.580 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.580 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.585 INFO:teuthology.orchestra.run.smithi079.stdout:4329 writesame 0x208e92b thru 0x209594f data_size 0x1(0x7025 bytes) 2024-09-21T13:59:51.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:51.608 INFO:teuthology.orchestra.run.smithi079.stdout:4331 trunc from 0xa1cdc83 to 0x9d97db5 2024-09-21T13:59:51.629 INFO:teuthology.orchestra.run.smithi079.stdout:4333 read 0x2e2cfd5 thru 0x2e3bf14 (0xef40 bytes) 2024-09-21T13:59:51.630 INFO:teuthology.orchestra.run.smithi079.stdout:4334 read 0x3d7a759 thru 0x3d83157 (0x89ff bytes) 2024-09-21T13:59:51.637 INFO:teuthology.orchestra.run.smithi079.stdout:4338 trunc from 0x9d97db5 to 0xc38c636 2024-09-21T13:59:51.647 INFO:teuthology.orchestra.run.smithi079.stdout:4341 writesame 0x93a520d thru 0x93b3e51 data_size 0x1(0xec45 bytes) 2024-09-21T13:59:51.648 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:51.648+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:51.693 INFO:teuthology.orchestra.run.smithi079.stdout:4342 write 0xe79ef3d thru 0xe7ab845 (0xc909 bytes) 2024-09-21T13:59:51.721 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:51.721 INFO:teuthology.orchestra.run.smithi079.stdout:4345 read 0x379d933 thru 0x37ab070 (0xd73e bytes) 2024-09-21T13:59:51.721 INFO:teuthology.orchestra.run.smithi079.stdout:4346 punch from 0x96ef499 to 0x96efbc5, (0x72c bytes) 2024-09-21T13:59:51.721 INFO:teuthology.orchestra.run.smithi079.stdout:4347 read 0x5292155 thru 0x5297a51 (0x58fd bytes) 2024-09-21T13:59:51.721 INFO:teuthology.orchestra.run.smithi079.stdout:4348 write 0x3fdcbc0 thru 0x3fe6664 (0x9aa5 bytes) 2024-09-21T13:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.741 INFO:teuthology.orchestra.run.smithi079.stdout:4349 punch from 0x29e73b5 to 0x29eaa92, (0x36dd bytes) 2024-09-21T13:59:51.741 INFO:teuthology.orchestra.run.smithi079.stdout:4352 write 0xc270d1f thru 0xc27e8d6 (0xdbb8 bytes) 2024-09-21T13:59:51.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:51.749 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:51.748+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:51.765 INFO:teuthology.orchestra.run.smithi079.stdout:4354 read 0x1f5365f thru 0x1f5e3b5 (0xad57 bytes) 2024-09-21T13:59:51.766 INFO:teuthology.orchestra.run.smithi079.stdout:4358 writesame 0x6732d93 thru 0x6734d21 data_size 0x1(0x1f8f bytes) 2024-09-21T13:59:51.774 INFO:teuthology.orchestra.run.smithi079.stdout:4359 write 0xb1e5e92 thru 0xb1e6b02 (0xc71 bytes) 2024-09-21T13:59:51.782 INFO:teuthology.orchestra.run.smithi079.stdout:4362 punch from 0x61347bc to 0x613a72d, (0x5f71 bytes) 2024-09-21T13:59:51.782 INFO:teuthology.orchestra.run.smithi079.stdout:4363 write 0xccc0c7f thru 0xcccd83f (0xcbc1 bytes) 2024-09-21T13:59:51.801 INFO:teuthology.orchestra.run.smithi079.stdout:4364 writesame 0x9342835 thru 0x9344f0c data_size 0x2c(0x26d8 bytes) 2024-09-21T13:59:51.815 INFO:teuthology.orchestra.run.smithi079.stdout:4365 trunc from 0xe7ab846 to 0xaa3d84e 2024-09-21T13:59:51.851 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:51.848+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:51.865 INFO:teuthology.orchestra.run.smithi079.stdout:4366 write 0xed67d6e thru 0xed71148 (0x93db bytes) 2024-09-21T13:59:51.873 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:51.873 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:51.887 INFO:teuthology.orchestra.run.smithi079.stdout:4367 read 0x20cbd2f thru 0x20db401 (0xf6d3 bytes) 2024-09-21T13:59:51.888 INFO:teuthology.orchestra.run.smithi079.stdout:4369 writesame 0x2e540ae thru 0x2e60b00 data_size 0xf(0xca53 bytes) 2024-09-21T13:59:51.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:51.899 INFO:teuthology.orchestra.run.smithi079.stdout:4370 read 0x379500a thru 0x379cc3f (0x7c36 bytes) 2024-09-21T13:59:51.929 INFO:teuthology.orchestra.run.smithi079.stdout:4375 trunc from 0xed71149 to 0x2e9c937 2024-09-21T13:59:51.951 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:51.948+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:51.976 INFO:teuthology.orchestra.run.smithi079.stdout:4376 read 0x1d2006 thru 0x1d5caf (0x3caa bytes) 2024-09-21T13:59:51.977 INFO:teuthology.orchestra.run.smithi079.stdout:4378 punch from 0x197b4de to 0x1984ada, (0x95fc bytes) 2024-09-21T13:59:51.977 INFO:teuthology.orchestra.run.smithi079.stdout:4379 write 0xe2ca61 thru 0xe3217e (0x571e bytes) 2024-09-21T13:59:51.994 INFO:teuthology.orchestra.run.smithi079.stdout:4381 write 0x3cc65c1 thru 0x3cd2b7b (0xc5bb bytes) 2024-09-21T13:59:52.019 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.019 INFO:teuthology.orchestra.run.smithi079.stdout:4383 punch from 0x23574ed to 0x235a920, (0x3433 bytes) 2024-09-21T13:59:52.024 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:52.024 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:52.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:52.038 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:52.047 INFO:teuthology.orchestra.run.smithi079.stdout:4385 write 0xb29483e thru 0xb29ce02 (0x85c5 bytes) 2024-09-21T13:59:52.065 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.065 INFO:teuthology.orchestra.run.smithi079.stdout:4388 write 0x1f5c383 thru 0x1f654c6 (0x9144 bytes) 2024-09-21T13:59:52.066 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:52.064+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:52.087 INFO:teuthology.orchestra.run.smithi079.stdout:4390 write 0xe3aff89 thru 0xe3babd7 (0xac4f bytes) 2024-09-21T13:59:52.104 INFO:teuthology.orchestra.run.smithi079.stdout:4391 read 0x5127700 thru 0x512f832 (0x8133 bytes) 2024-09-21T13:59:52.104 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.104 INFO:teuthology.orchestra.run.smithi079.stdout:4393 read 0x81c3237 thru 0x81caf18 (0x7ce2 bytes) 2024-09-21T13:59:52.104 INFO:teuthology.orchestra.run.smithi079.stdout:4394 writesame 0x8518e09 thru 0x8526c6e data_size 0x9(0xde66 bytes) 2024-09-21T13:59:52.129 INFO:teuthology.orchestra.run.smithi079.stdout:4395 read 0xa342354 thru 0xa3485f3 (0x62a0 bytes) 2024-09-21T13:59:52.129 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.129 INFO:teuthology.orchestra.run.smithi079.stdout:4398 write 0x21c66f9 thru 0x21d0902 (0xa20a bytes) 2024-09-21T13:59:52.153 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:52.152+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:52.155 INFO:teuthology.orchestra.run.smithi079.stdout:4400 punch from 0x243f904 to 0x2445358, (0x5a54 bytes) 2024-09-21T13:59:52.156 INFO:teuthology.orchestra.run.smithi079.stdout:4401 read 0x8ec9cc4 thru 0x8ed90dc (0xf419 bytes) 2024-09-21T13:59:52.156 INFO:teuthology.orchestra.run.smithi079.stdout:4402 read 0x1ca7a2c thru 0x1cab06f (0x3644 bytes) 2024-09-21T13:59:52.158 INFO:teuthology.orchestra.run.smithi079.stdout:4404 trunc from 0xe3babd8 to 0xd3a7d1a 2024-09-21T13:59:52.178 INFO:teuthology.orchestra.run.smithi079.stdout:4405 read 0xa77d01 thru 0xa83f7f (0xc27f bytes) 2024-09-21T13:59:52.179 INFO:teuthology.orchestra.run.smithi079.stdout:4406 write 0xc2d8097 thru 0xc2daa5d (0x29c7 bytes) 2024-09-21T13:59:52.187 INFO:teuthology.orchestra.run.smithi079.stdout:4407 punch from 0x9b8ba34 to 0x9b9720e, (0xb7da bytes) 2024-09-21T13:59:52.188 INFO:teuthology.orchestra.run.smithi079.stdout:4408 write 0x75c616c thru 0x75ccb85 (0x6a1a bytes) 2024-09-21T13:59:52.188 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:52.188 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:52.199 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:52.199 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:52.203 INFO:teuthology.orchestra.run.smithi079.stdout:4409 read 0x3993668 thru 0x399798a (0x4323 bytes) 2024-09-21T13:59:52.203 INFO:teuthology.orchestra.run.smithi079.stdout:4410 write 0x7f5b5be thru 0x7f631ef (0x7c32 bytes) 2024-09-21T13:59:52.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:52.217 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:52.217 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:52.223 INFO:teuthology.orchestra.run.smithi079.stdout:4411 read 0x39e6757 thru 0x39f15b8 (0xae62 bytes) 2024-09-21T13:59:52.223 INFO:teuthology.orchestra.run.smithi079.stdout:4412 read 0x78054f9 thru 0x780b2cb (0x5dd3 bytes) 2024-09-21T13:59:52.224 INFO:teuthology.orchestra.run.smithi079.stdout:4414 write 0x537c459 thru 0x537f55c (0x3104 bytes) 2024-09-21T13:59:52.234 INFO:teuthology.orchestra.run.smithi079.stdout:4415 writesame 0xb345423 thru 0xb349555 data_size 0x1(0x4133 bytes) 2024-09-21T13:59:52.236 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:52.237 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:52.240 INFO:teuthology.orchestra.run.smithi079.stdout:4418 read 0x3a4f00d thru 0x3a5d6d8 (0xe6cc bytes) 2024-09-21T13:59:52.240 INFO:teuthology.orchestra.run.smithi079.stdout:4419 read 0x3044b49 thru 0x304c823 (0x7cdb bytes) 2024-09-21T13:59:52.250 INFO:teuthology.orchestra.run.smithi079.stdout:4420 trunc from 0xd3a7d1a to 0x78c3ca7 2024-09-21T13:59:52.254 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:52.252+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:52.256 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:52.256 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:52.279 INFO:teuthology.orchestra.run.smithi079.stdout:4422 trunc from 0x78c3ca7 to 0x87a6684 2024-09-21T13:59:52.280 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:52.280 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:52.288 INFO:teuthology.orchestra.run.smithi079.stdout:4423 writesame 0x676837f thru 0x676da4a data_size 0x65(0x56cc bytes) 2024-09-21T13:59:52.301 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:52.301 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:52.309 INFO:teuthology.orchestra.run.smithi079.stdout:4424 trunc from 0x87a6684 to 0x290adff 2024-09-21T13:59:52.326 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:52.326 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:52.329 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:52.330 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:52.349 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:52.349 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:52.349 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:52.354 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:52.352+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:52.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:52.369 INFO:teuthology.orchestra.run.smithi079.stdout:4430 write 0xe5b1221 thru 0xe5ba80a (0x95ea bytes) 2024-09-21T13:59:52.400 INFO:teuthology.orchestra.run.smithi079.stdout:4431 read 0xbeee562 thru 0xbefc0f9 (0xdb98 bytes) 2024-09-21T13:59:52.400 INFO:teuthology.orchestra.run.smithi079.stdout:4432 write 0xd419ccf thru 0xd41c184 (0x24b6 bytes) 2024-09-21T13:59:52.422 INFO:teuthology.orchestra.run.smithi079.stdout:4434 trunc from 0xe5ba80b to 0x80af6dc 2024-09-21T13:59:52.448 INFO:teuthology.orchestra.run.smithi079.stdout:4435 read 0x38fb412 thru 0x390b106 (0xfcf5 bytes) 2024-09-21T13:59:52.448 INFO:teuthology.orchestra.run.smithi079.stdout:4438 punch from 0x5942d62 to 0x594b31f, (0x85bd bytes) 2024-09-21T13:59:52.449 INFO:teuthology.orchestra.run.smithi079.stdout:4443 read 0x1011347 thru 0x1018fec (0x7ca6 bytes) 2024-09-21T13:59:52.449 INFO:teuthology.orchestra.run.smithi079.stdout:4444 write 0x77ea8ee thru 0x77ebfce (0x16e1 bytes) 2024-09-21T13:59:52.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:52.456+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:52.458 INFO:teuthology.orchestra.run.smithi079.stdout:4446 write 0x7d49115 thru 0x7d4d2f2 (0x41de bytes) 2024-09-21T13:59:52.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T13:59:52.494 INFO:teuthology.orchestra.run.smithi079.stdout:4447 write 0xc91aae4 thru 0xc926e75 (0xc392 bytes) 2024-09-21T13:59:52.497 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.891302057999994, 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T13:59:52.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T13:59:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.959756317999997, 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T13:59:52.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:52.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.959740949999997, 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:52.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.959725800000001, 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T13:59:52.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T13:59:52.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.959690287000001, 2024-09-21T13:59:52.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T13:59:52.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T13:59:52.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 49.613983282, 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.523 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.943960642, 2024-09-21T13:59:52.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T13:59:52.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:52.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T13:59:52.533 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.942632932000002, 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:52.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T13:59:52.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T13:59:52.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0984520609999997, 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T13:59:52.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0983805370000006, 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T13:59:52.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T13:59:52.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T13:59:52.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:52.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0982850150000001, 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T13:59:52.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0982289170000001, 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T13:59:52.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T13:59:52.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T13:59:52.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0981933870000002, 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T13:59:52.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T13:59:52.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0981682680000002, 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.567 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207983 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10407936~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695521+0000", 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.8018337239999997, 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051787903000000003, 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207983 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695521+0000", 2024-09-21T13:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695521+0000", 2024-09-21T13:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695520+0000", 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695523+0000", 2024-09-21T13:59:52.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5040000000000001e-06 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695529+0000", 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2129999999999996e-06 2024-09-21T13:59:52.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695534+0000", 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9099999999999996e-06 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747121+0000", 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051586649999999998 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747213+0000", 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2442999999999996e-05 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747309+0000", 2024-09-21T13:59:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5749999999999996e-05 2024-09-21T13:59:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.801662469, 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T13:59:52.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T13:59:52.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T13:59:52.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T13:59:52.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T13:59:52.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T13:59:52.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208072 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8654848~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696958+0000", 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.8003971160000001, 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051769032, 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208072 2024-09-21T13:59:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696958+0000", 2024-09-21T13:59:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696958+0000", 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696957+0000", 2024-09-21T13:59:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696960+0000", 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5320000000000001e-06 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696966+0000", 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0140000000000004e-06 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696971+0000", 2024-09-21T13:59:52.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3179999999999997e-06 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748569+0000", 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051597780000000003 2024-09-21T13:59:52.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748628+0000", 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9546000000000002e-05 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748727+0000", 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8183999999999994e-05 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.8003794869999998, 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T13:59:52.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T13:59:52.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.8003331409999999, 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T13:59:52.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.7932156190000001, 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:52.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:52.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T13:59:52.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:52.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:52.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:52.622 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:52.623 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:52.624 INFO:teuthology.orchestra.run.smithi079.stdout:4448 write 0xbfd3422 thru 0xbfdc364 (0x8f43 bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4450 read 0x9c84ff thru 0x9cb3e7 (0x2ee9 bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4452 write 0x553e0e9 thru 0x554a265 (0xc17d bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4453 write 0x99a036 thru 0x99cde3 (0x2dae bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4454 write 0xa61f51 thru 0xa662ed (0x439d bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4456 punch from 0x86e1e71 to 0x86e689e, (0x4a2d bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4457 write 0xd34c497 thru 0xd34fbd3 (0x373d bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:4458 punch from 0x50bb626 to 0x50c7ba7, (0xc581 bytes) 2024-09-21T13:59:52.625 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.626 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:52.620+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:52.630 INFO:teuthology.orchestra.run.smithi079.stdout:4461 writesame 0xedb4eea thru 0xedb621e data_size 0xb(0x1335 bytes) 2024-09-21T13:59:52.630 INFO:teuthology.orchestra.run.smithi079.stdout:4465 read 0xed54404 thru 0xed603e8 (0xbfe5 bytes) 2024-09-21T13:59:52.630 INFO:teuthology.orchestra.run.smithi079.stdout:4466 read 0xded5ec8 thru 0xdedde50 (0x7f89 bytes) 2024-09-21T13:59:52.631 INFO:teuthology.orchestra.run.smithi079.stdout:4467 read 0x278db3c thru 0x2798ba5 (0xb06a bytes) 2024-09-21T13:59:52.631 INFO:teuthology.orchestra.run.smithi079.stdout:4468 read 0xd438c44 thru 0xd43fd6b (0x7128 bytes) 2024-09-21T13:59:52.632 INFO:teuthology.orchestra.run.smithi079.stdout:4469 writesame 0x57669cf thru 0x5775775 data_size 0x1(0xeda7 bytes) 2024-09-21T13:59:52.655 INFO:teuthology.orchestra.run.smithi079.stdout:4471 punch from 0x96e45ea to 0x96f1515, (0xcf2b bytes) 2024-09-21T13:59:52.655 INFO:teuthology.orchestra.run.smithi079.stdout:4472 read 0xb8465a thru 0xb93c27 (0xf5ce bytes) 2024-09-21T13:59:52.656 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:52.671 INFO:teuthology.orchestra.run.smithi079.stdout:4474 trunc from 0xedb621f to 0x4c79899 2024-09-21T13:59:52.703 INFO:teuthology.orchestra.run.smithi079.stdout:4476 punch from 0x952ef9 to 0x9535c4, (0x6cb bytes) 2024-09-21T13:59:52.709 INFO:teuthology.orchestra.run.smithi079.stdout:4479 trunc from 0x4c79899 to 0x94f9042 2024-09-21T13:59:52.724 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:52.724+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:52.728 INFO:teuthology.orchestra.run.smithi079.stdout:4480 trunc from 0x94f9042 to 0xe2a01f8 2024-09-21T13:59:52.740 INFO:teuthology.orchestra.run.smithi079.stdout:4481 writesame 0x33d9234 thru 0x33de206 data_size 0x3d(0x4fd3 bytes) 2024-09-21T13:59:52.756 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:52.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:52.757 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:52.757 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:4482 read 0x9860a8c thru 0x9867b1b (0x7090 bytes) 2024-09-21T13:59:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:4483 read 0x3f6cfe4 thru 0x3f7ad4c (0xdd69 bytes) 2024-09-21T13:59:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:4484 punch from 0x49bded5 to 0x49c9d24, (0xbe4f bytes) 2024-09-21T13:59:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:4485 writesame 0xc25390f thru 0xc260ad5 data_size 0x99(0xd1c7 bytes) 2024-09-21T13:59:52.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:52.794 INFO:teuthology.orchestra.run.smithi079.stdout:4486 write 0x3600505 thru 0x3608891 (0x838d bytes) 2024-09-21T13:59:52.825 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:52.820+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:52.908 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:52.908 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:52.908 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:52.908 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:52.908 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:52.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:52.926 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:52.920+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:53.001 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.001 INFO:teuthology.orchestra.run.smithi079.stdout:4488 punch from 0x49a8e77 to 0x49b1c51, (0x8dda bytes) 2024-09-21T13:59:53.016 INFO:teuthology.orchestra.run.smithi079.stdout:4489 writesame 0xe871cce thru 0xe878877 data_size 0x1(0x6baa bytes) 2024-09-21T13:59:53.027 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:53.024+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:53.039 INFO:teuthology.orchestra.run.smithi079.stdout:4490 trunc from 0xe878878 to 0x3574ab0 2024-09-21T13:59:53.051 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.212282802000004, 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.072259361999997, 2024-09-21T13:59:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.044000357000002, 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.146891812000007, 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.146830343000005, 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137766368000001, 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137708607999997, 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137690015999993, 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137677678000003, 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137655941999995, 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137632758999999, 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137612329999996, 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137597532000001, 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137572947999999, 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:53.119 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137556251999996, 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:53.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:53.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 80.137534015, 2024-09-21T13:59:53.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:53.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:53.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.219245712000003, 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:53.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:53.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.049727164000004, 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:53.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:53.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:53.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.686488569999995, 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:53.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:53.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.41608297700000002, 2024-09-21T13:59:53.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T13:59:53.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T13:59:53.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.150 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:53.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:53.152 INFO:teuthology.orchestra.run.smithi079.stdout:4491 write 0x5943de9 thru 0x5947351 (0x3569 bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4493 read 0x3e90df3 thru 0x3e97770 (0x697e bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4494 punch from 0x328979e to 0x3292743, (0x8fa5 bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4495 read 0x4eb91ef thru 0x4ec7e97 (0xeca9 bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4496 punch from 0x3db4a6e to 0x3db911b, (0x46ad bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4497 read 0x2d26430 thru 0x2d2df7e (0x7b4f bytes) 2024-09-21T13:59:53.153 INFO:teuthology.orchestra.run.smithi079.stdout:4498 write 0x848e443 thru 0x849b8e0 (0xd49e bytes) 2024-09-21T13:59:53.153 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:53.148+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:53.157 INFO:teuthology.orchestra.run.smithi079.stdout:4499 read 0x353a3e7 thru 0x353affe (0xc18 bytes) 2024-09-21T13:59:53.179 INFO:teuthology.orchestra.run.smithi079.stdout:4501 write 0xbcfb7f8 thru 0xbcfedf5 (0x35fe bytes) 2024-09-21T13:59:53.193 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.193 INFO:teuthology.orchestra.run.smithi079.stdout:4504 write 0x40a0e85 thru 0x40aec9c (0xde18 bytes) 2024-09-21T13:59:53.228 INFO:teuthology.orchestra.run.smithi079.stdout:4505 writesame 0xaeb15e1 thru 0xaeb9fae data_size 0x1f(0x89ce bytes) 2024-09-21T13:59:53.252 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:53.248+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:53.253 INFO:teuthology.orchestra.run.smithi079.stdout:4506 read 0x9d33885 thru 0x9d3b56f (0x7ceb bytes) 2024-09-21T13:59:53.254 INFO:teuthology.orchestra.run.smithi079.stdout:4507 trunc from 0xbcfedf6 to 0xb3bfda6 2024-09-21T13:59:53.275 INFO:teuthology.orchestra.run.smithi079.stdout:4508 writesame 0x4eae2b9 thru 0x4eba55e data_size 0x42(0xc2a6 bytes) 2024-09-21T13:59:53.289 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:53.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:53.290 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:53.290 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:53.306 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:53.306 INFO:teuthology.orchestra.run.smithi079.stdout:4511 read 0x520a6b5 thru 0x5218a20 (0xe36c bytes) 2024-09-21T13:59:53.308 INFO:teuthology.orchestra.run.smithi079.stdout:4513 read 0x29b2ffe thru 0x29c0e20 (0xde23 bytes) 2024-09-21T13:59:53.308 INFO:teuthology.orchestra.run.smithi079.stdout:4514 write 0x3fbba3 thru 0x40b232 (0xf690 bytes) 2024-09-21T13:59:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:4517 write 0xa366256 thru 0xa370825 (0xa5d0 bytes) 2024-09-21T13:59:53.352 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:53.352+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:53.371 INFO:teuthology.orchestra.run.smithi079.stdout:4519 read 0x6b6e901 thru 0x6b76a7e (0x817e bytes) 2024-09-21T13:59:53.371 INFO:teuthology.orchestra.run.smithi079.stdout:4520 write 0xa143995 thru 0xa14aad4 (0x7140 bytes) 2024-09-21T13:59:53.376 INFO:teuthology.orchestra.run.smithi079.stdout:4521 write 0x87cc166 thru 0x87d036b (0x4206 bytes) 2024-09-21T13:59:53.379 INFO:teuthology.orchestra.run.smithi079.stdout:4523 read 0x61be8b1 thru 0x61cdde7 (0xf537 bytes) 2024-09-21T13:59:53.388 INFO:teuthology.orchestra.run.smithi079.stdout:4524 trunc from 0xb3bfda6 to 0x5089d03 2024-09-21T13:59:53.422 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.438 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:53.438 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:53.438 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:53.438 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:53.439 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:53.444 INFO:teuthology.orchestra.run.smithi079.stdout:4528 writesame 0xc6f647d thru 0xc6f9bff data_size 0x3(0x3783 bytes) 2024-09-21T13:59:53.446 INFO:teuthology.orchestra.run.smithi079.stdout:4529 trunc from 0xc6f9c00 to 0xb07be4d 2024-09-21T13:59:53.453 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:53.452+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:53.454 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:53.459 INFO:teuthology.orchestra.run.smithi079.stdout:4531 read 0x15daffd thru 0x15e5101 (0xa105 bytes) 2024-09-21T13:59:53.459 INFO:teuthology.orchestra.run.smithi079.stdout:4532 read 0x6349dbd thru 0x6352ff7 (0x923b bytes) 2024-09-21T13:59:53.460 INFO:teuthology.orchestra.run.smithi079.stdout:4533 punch from 0xa0ef048 to 0xa0fbae4, (0xca9c bytes) 2024-09-21T13:59:53.460 INFO:teuthology.orchestra.run.smithi079.stdout:4534 write 0x86435c0 thru 0x8653514 (0xff55 bytes) 2024-09-21T13:59:53.466 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 6, 7, 1] out_osds: [2] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-21T13:59:53.466 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T13:59:53.466 INFO:tasks.thrashosds.thrasher:Reviving osd 7 2024-09-21T13:59:53.466 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-21T13:59:53.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-21T13:59:53.469 INFO:tasks.ceph.osd.7:Started 2024-09-21T13:59:53.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:59:53.483 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T13:59:53.490 INFO:teuthology.orchestra.run.smithi079.stdout:4535 write 0x2d24a63 thru 0x2d322a4 (0xd842 bytes) 2024-09-21T13:59:53.511 INFO:teuthology.orchestra.run.smithi079.stdout:4536 writesame 0x358a4bc thru 0x3594a8c data_size 0x11(0xa5d1 bytes) 2024-09-21T13:59:53.519 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.519 INFO:teuthology.orchestra.run.smithi079.stdout:4538 writesame 0xab81133 thru 0xab8ef1d data_size 0x1d(0xddeb bytes) 2024-09-21T13:59:53.537 INFO:teuthology.orchestra.run.smithi079.stdout:4539 read 0x54a6f5b thru 0x54b3aa4 (0xcb4a bytes) 2024-09-21T13:59:53.537 INFO:teuthology.orchestra.run.smithi079.stdout:4540 punch from 0x9a014d7 to 0x9a051b7, (0x3ce0 bytes) 2024-09-21T13:59:53.545 INFO:teuthology.orchestra.run.smithi079.stdout:4541 write 0xc5fef20 thru 0xc60e5b7 (0xf698 bytes) 2024-09-21T13:59:53.554 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:53.552+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:53.562 INFO:teuthology.orchestra.run.smithi079.stdout:4542 punch from 0xc20265c to 0xc204178, (0x1b1c bytes) 2024-09-21T13:59:53.562 INFO:teuthology.orchestra.run.smithi079.stdout:4543 read 0x28ca6ca thru 0x28cfaf9 (0x5430 bytes) 2024-09-21T13:59:53.562 INFO:teuthology.orchestra.run.smithi079.stdout:4544 write 0x898995d thru 0x898a21f (0x8c3 bytes) 2024-09-21T13:59:53.577 INFO:teuthology.orchestra.run.smithi079.stdout:4545 trunc from 0xc60e5b8 to 0x4b01eed 2024-09-21T13:59:53.599 INFO:teuthology.orchestra.run.smithi079.stdout:4546 read 0xa6d59 thru 0xad5ef (0x6897 bytes) 2024-09-21T13:59:53.600 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:53.600 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:53.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:53.600 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079729436999997, 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:53.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079617814000002, 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:53.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.607 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:53.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:53.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:53.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:53.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079597991, 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079573812000007, 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:53.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079549706999998, 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:53.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079531197999998, 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.627 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:53.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:53.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079521455999995, 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.632 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:53.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.636 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079496597000002, 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:53.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079467919999999, 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:53.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079449101999998, 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:53.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:53.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079428430999997, 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:53.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:53.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079407360000005, 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:53.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079371507999994, 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:53.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:53.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079339286000007, 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079303646, 2024-09-21T13:59:53.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079269167999996, 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:53.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.677 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079214608000001, 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.678 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:53.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079175442999997, 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:53.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079136707000004, 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:53.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:53.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.079111953999998, 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:53.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:53.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:53.697 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:53.698 INFO:teuthology.orchestra.run.smithi079.stdout:4547 read 0x3753788 thru 0x375c1bd (0x8a36 bytes) 2024-09-21T13:59:53.698 INFO:teuthology.orchestra.run.smithi079.stdout:4548 read 0x380d445 thru 0x381c8f5 (0xf4b1 bytes) 2024-09-21T13:59:53.698 INFO:teuthology.orchestra.run.smithi079.stdout:4549 punch from 0x360c8d1 to 0x361a669, (0xdd98 bytes) 2024-09-21T13:59:53.698 INFO:teuthology.orchestra.run.smithi079.stdout:4550 write 0xa883b7a thru 0xa88d73b (0x9bc2 bytes) 2024-09-21T13:59:53.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:53.700 INFO:teuthology.orchestra.run.smithi079.stdout:4551 punch from 0x46e5f92 to 0x46ef311, (0x937f bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4553 write 0x96b17f0 thru 0x96ba511 (0x8d22 bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4554 writesame 0x210811b thru 0x210eaeb data_size 0x1(0x69d1 bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4555 write 0xaaccc18 thru 0xaacdbef (0xfd8 bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4559 read 0xf77529 thru 0xf84fe1 (0xdab9 bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4560 write 0x9106309 thru 0x910c954 (0x664c bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4561 writesame 0xb608315 thru 0xb6104c1 data_size 0x1(0x81ad bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4562 punch from 0xb445e6b to 0xb453c8e, (0xde23 bytes) 2024-09-21T13:59:53.701 INFO:teuthology.orchestra.run.smithi079.stdout:4563 write 0x4dafc48 thru 0x4dbe6ce (0xea87 bytes) 2024-09-21T13:59:53.702 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-21T13:59:53.702 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-21T13:59:53.702 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-09-21T13:59:53.703 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:53.696+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:53.706 INFO:teuthology.orchestra.run.smithi079.stdout:4564 write 0xd43a497 thru 0xd44159e (0x7108 bytes) 2024-09-21T13:59:53.718 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.718 INFO:teuthology.orchestra.run.smithi079.stdout:4567 punch from 0x81887e7 to 0x8196561, (0xdd7a bytes) 2024-09-21T13:59:53.718 INFO:teuthology.orchestra.run.smithi079.stdout:4568 write 0x9ba2f06 thru 0x9bad1e2 (0xa2dd bytes) 2024-09-21T13:59:53.732 INFO:teuthology.orchestra.run.smithi079.stdout:4569 write 0x65589a3 thru 0x655fbff (0x725d bytes) 2024-09-21T13:59:53.743 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.761 INFO:teuthology.orchestra.run.smithi079.stdout:4571 trunc from 0xd44159f to 0x338ae9c 2024-09-21T13:59:53.803 INFO:teuthology.orchestra.run.smithi079.stdout:4572 write 0x3a7585c thru 0x3a84b30 (0xf2d5 bytes) 2024-09-21T13:59:53.803 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:53.804+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:53.821 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:53.845 INFO:teuthology.orchestra.run.smithi079.stdout:4576 write 0xbb3eb70 thru 0xbb4d309 (0xe79a bytes) 2024-09-21T13:59:53.864 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:53.864 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:53.864 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:53.864 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:53.867 INFO:teuthology.orchestra.run.smithi079.stdout:4578 read 0xb01c3ad thru 0xb022d09 (0x695d bytes) 2024-09-21T13:59:53.867 INFO:teuthology.orchestra.run.smithi079.stdout:4579 write 0x8df3834 thru 0x8dff14b (0xb918 bytes) 2024-09-21T13:59:53.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:53.891 INFO:teuthology.orchestra.run.smithi079.stdout:4580 write 0x8dac22a thru 0x8db032f (0x4106 bytes) 2024-09-21T13:59:53.896 INFO:teuthology.orchestra.run.smithi079.stdout:4581 writesame 0x1494a80 thru 0x149c7ec data_size 0x4d(0x7d6d bytes) 2024-09-21T13:59:53.905 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:53.900+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:53.915 INFO:teuthology.orchestra.run.smithi079.stdout:4582 read 0x2a3c05c thru 0x2a460bf (0xa064 bytes) 2024-09-21T13:59:53.915 INFO:teuthology.orchestra.run.smithi079.stdout:4584 read 0x85c99b2 thru 0x85d2baf (0x91fe bytes) 2024-09-21T13:59:53.915 INFO:teuthology.orchestra.run.smithi079.stdout:4585 writesame 0x2e1be28 thru 0x2e1d056 data_size 0x23(0x122f bytes) 2024-09-21T13:59:53.917 INFO:teuthology.orchestra.run.smithi079.stdout:4586 read 0x5409563 thru 0x5412975 (0x9413 bytes) 2024-09-21T13:59:53.917 INFO:teuthology.orchestra.run.smithi079.stdout:4587 punch from 0x74b9f81 to 0x74bbabb, (0x1b3a bytes) 2024-09-21T13:59:53.925 INFO:teuthology.orchestra.run.smithi079.stdout:4588 write 0xc1f497a thru 0xc2043c4 (0xfa4b bytes) 2024-09-21T13:59:53.936 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:59:53.932+0000 7f74309577c0 -1 Falling back to public interface 2024-09-21T13:59:53.945 INFO:teuthology.orchestra.run.smithi079.stdout:4589 writesame 0x83fd46c thru 0x8400dc1 data_size 0x2(0x3956 bytes) 2024-09-21T13:59:53.953 INFO:teuthology.orchestra.run.smithi079.stdout:4590 read 0x8acd7c1 thru 0x8ada5a8 (0xcde8 bytes) 2024-09-21T13:59:53.955 INFO:teuthology.orchestra.run.smithi079.stdout:4591 punch from 0x38833de to 0x3886f1c, (0x3b3e bytes) 2024-09-21T13:59:53.955 INFO:teuthology.orchestra.run.smithi079.stdout:4594 write 0x178aa2 thru 0x18015e (0x76bd bytes) 2024-09-21T13:59:53.973 INFO:teuthology.orchestra.run.smithi079.stdout:4595 writesame 0xebf8a25 thru 0xebfe150 data_size 0xe(0x572c bytes) 2024-09-21T13:59:53.973 INFO:teuthology.orchestra.run.smithi079.stdout:4596 read 0x48cebad thru 0x48dcbbe (0xe012 bytes) 2024-09-21T13:59:53.973 INFO:teuthology.orchestra.run.smithi079.stdout:4598 writesame 0x896a172 thru 0x8974a7e data_size 0x1(0xa90d bytes) 2024-09-21T13:59:53.994 INFO:teuthology.orchestra.run.smithi079.stdout:4600 read 0x6b2f17 thru 0x6b8618 (0x5702 bytes) 2024-09-21T13:59:53.996 INFO:teuthology.orchestra.run.smithi079.stdout:4602 write 0x6ab6b3 thru 0x6ac3ab (0xcf9 bytes) 2024-09-21T13:59:53.997 INFO:teuthology.orchestra.run.smithi079.stdout:4603 write 0xaccd7be thru 0xaccfcb8 (0x24fb bytes) 2024-09-21T13:59:54.005 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:54.000+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:54.017 INFO:teuthology.orchestra.run.smithi079.stdout:4604 trunc from 0xebfe151 to 0x5d43eb6 2024-09-21T13:59:54.029 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:54.030 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:54.045 INFO:teuthology.orchestra.run.smithi079.stdout:4605 punch from 0x111dee4 to 0x1125780, (0x789c bytes) 2024-09-21T13:59:54.046 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:54.047 INFO:teuthology.orchestra.run.smithi079.stdout:4607 trunc from 0x5d43eb6 to 0x74784ad 2024-09-21T13:59:54.055 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.055 INFO:teuthology.orchestra.run.smithi079.stdout:4609 write 0x5d49507 thru 0x5d4f4ce (0x5fc8 bytes) 2024-09-21T13:59:54.068 INFO:teuthology.orchestra.run.smithi079.stdout:4611 punch from 0x2db0cab to 0x2db9c54, (0x8fa9 bytes) 2024-09-21T13:59:54.082 INFO:teuthology.orchestra.run.smithi079.stdout:4612 write 0xb695829 thru 0xb69892a (0x3102 bytes) 2024-09-21T13:59:54.092 INFO:teuthology.orchestra.run.smithi079.stdout:4613 read 0x984a8bb thru 0x9853ba2 (0x92e8 bytes) 2024-09-21T13:59:54.092 INFO:teuthology.orchestra.run.smithi079.stdout:4615 writesame 0x876e575 thru 0x877036e data_size 0x3(0x1dfa bytes) 2024-09-21T13:59:54.102 INFO:teuthology.orchestra.run.smithi079.stdout:4616 trunc from 0xb69892b to 0xe5b9bb7 2024-09-21T13:59:54.106 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:54.104+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:54.113 INFO:teuthology.orchestra.run.smithi079.stdout:4617 write 0x211ca9a thru 0x21284c8 (0xba2f bytes) 2024-09-21T13:59:54.117 INFO:teuthology.orchestra.run.smithi079.stdout:4618 write 0xa228374 thru 0xa231b70 (0x97fd bytes) 2024-09-21T13:59:54.138 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.138 INFO:teuthology.orchestra.run.smithi079.stdout:4624 write 0xbe14263 thru 0xbe18c97 (0x4a35 bytes) 2024-09-21T13:59:54.161 INFO:teuthology.orchestra.run.smithi079.stdout:4625 writesame 0xe82c0b7 thru 0xe83aff9 data_size 0x11(0xef43 bytes) 2024-09-21T13:59:54.161 INFO:teuthology.orchestra.run.smithi079.stdout:4626 read 0xa20c5bd thru 0xa21ae4f (0xe893 bytes) 2024-09-21T13:59:54.162 INFO:teuthology.orchestra.run.smithi079.stdout:4627 read 0x3ebc2e3 thru 0x3ecb3cf (0xf0ed bytes) 2024-09-21T13:59:54.162 INFO:teuthology.orchestra.run.smithi079.stdout:4628 read 0xa754bf6 thru 0xa7578b6 (0x2cc1 bytes) 2024-09-21T13:59:54.162 INFO:teuthology.orchestra.run.smithi079.stdout:4629 read 0x86c342a thru 0x86d1b5f (0xe736 bytes) 2024-09-21T13:59:54.162 INFO:teuthology.orchestra.run.smithi079.stdout:4630 read 0xbae50c9 thru 0xbae9b17 (0x4a4f bytes) 2024-09-21T13:59:54.162 INFO:teuthology.orchestra.run.smithi079.stdout:4631 read 0xc05d4d6 thru 0xc06b4df (0xe00a bytes) 2024-09-21T13:59:54.163 INFO:teuthology.orchestra.run.smithi079.stdout:4632 punch from 0x994bc8a to 0x99543e1, (0x8757 bytes) 2024-09-21T13:59:54.163 INFO:teuthology.orchestra.run.smithi079.stdout:4633 punch from 0x63507dc to 0x6352ba0, (0x23c4 bytes) 2024-09-21T13:59:54.163 INFO:teuthology.orchestra.run.smithi079.stdout:4634 read 0xd86a063 thru 0xd86f591 (0x552f bytes) 2024-09-21T13:59:54.163 INFO:teuthology.orchestra.run.smithi079.stdout:4635 write 0x689649 thru 0x69307d (0x9a35 bytes) 2024-09-21T13:59:54.169 INFO:teuthology.orchestra.run.smithi079.stdout:4636 read 0x46bb9b9 thru 0x46c5513 (0x9b5b bytes) 2024-09-21T13:59:54.178 INFO:teuthology.orchestra.run.smithi079.stdout:4637 trunc from 0xe83affa to 0x8ab05dd 2024-09-21T13:59:54.182 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.779142204999999, 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:54.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:54.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.739055367000006, 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:54.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:54.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.677742111000001, 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.197 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2132831729999998, 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T13:59:54.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2132358940000003, 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T13:59:54.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T13:59:54.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2131963920000004, 2024-09-21T13:59:54.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T13:59:54.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 6.2131573329999998, 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T13:59:54.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T13:59:54.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6847936749999999, 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.215 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T13:59:54.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T13:59:54.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6847659850000003, 2024-09-21T13:59:54.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T13:59:54.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6847434989999996, 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6846963859999997, 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:54.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:54.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6846757400000003, 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T13:59:54.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T13:59:54.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6846514490000004, 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:54.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T13:59:54.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6846309460000004, 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T13:59:54.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6846086319999998, 2024-09-21T13:59:54.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T13:59:54.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T13:59:54.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6845904469999997, 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T13:59:54.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6845719670000001, 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T13:59:54.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.258 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6845262989999998, 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:54.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.262 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6845015779999999, 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.263 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T13:59:54.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.6844824640000002, 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:54.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:54.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:54.271 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:54.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:4640 write 0x782a028 thru 0x783770a (0xd6e3 bytes) 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:4643 read 0x5bf4871 thru 0x5bf9023 (0x47b3 bytes) 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:4645 write 0x8cac24e thru 0x8caf404 (0x31b7 bytes) 2024-09-21T13:59:54.274 INFO:teuthology.orchestra.run.smithi079.stdout:4646 write 0xac318de thru 0xac3985f (0x7f82 bytes) 2024-09-21T13:59:54.274 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:54.268+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:54.281 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.293 INFO:teuthology.orchestra.run.smithi079.stdout:4650 write 0xbae1c4e thru 0xbaec014 (0xa3c7 bytes) 2024-09-21T13:59:54.313 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.313 INFO:teuthology.orchestra.run.smithi079.stdout:4654 read 0x4908c4c thru 0x49179e8 (0xed9d bytes) 2024-09-21T13:59:54.313 INFO:teuthology.orchestra.run.smithi079.stdout:4655 write 0x89be37f thru 0x89cde0d (0xfa8f bytes) 2024-09-21T13:59:54.326 INFO:teuthology.orchestra.run.smithi079.stdout:4656 punch from 0x5f7d765 to 0x5f7e85f, (0x10fa bytes) 2024-09-21T13:59:54.326 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.330 INFO:teuthology.orchestra.run.smithi079.stdout:4658 trunc from 0xbaec015 to 0x9771567 2024-09-21T13:59:54.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:54.349 INFO:teuthology.orchestra.run.smithi079.stdout:4660 writesame 0xa6a03c thru 0xa71693 data_size 0x1c(0x7658 bytes) 2024-09-21T13:59:54.352 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.352 INFO:teuthology.orchestra.run.smithi079.stdout:4662 read 0x36013b7 thru 0x3606b6b (0x57b5 bytes) 2024-09-21T13:59:54.353 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.367 INFO:teuthology.orchestra.run.smithi079.stdout:4664 write 0xcf63c5c thru 0xcf662c9 (0x266e bytes) 2024-09-21T13:59:54.373 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:54.368+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:54.375 INFO:teuthology.orchestra.run.smithi079.stdout:4666 writesame 0x2970bed thru 0x2974eda data_size 0xd(0x42ee bytes) 2024-09-21T13:59:54.387 INFO:teuthology.orchestra.run.smithi079.stdout:4667 trunc from 0xcf662ca to 0xae0fc98 2024-09-21T13:59:54.402 INFO:teuthology.orchestra.run.smithi079.stdout:4668 read 0x96a2345 thru 0x96acabf (0xa77b bytes) 2024-09-21T13:59:54.402 INFO:teuthology.orchestra.run.smithi079.stdout:4669 read 0x2b2188a thru 0x2b2752a (0x5ca1 bytes) 2024-09-21T13:59:54.403 INFO:teuthology.orchestra.run.smithi079.stdout:4670 write 0xa469c68 thru 0xa477002 (0xd39b bytes) 2024-09-21T13:59:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:54.420 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:54.420 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:54.420 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:54.422 INFO:teuthology.orchestra.run.smithi079.stdout:4672 write 0x3f466a9 thru 0x3f4d1b2 (0x6b0a bytes) 2024-09-21T13:59:54.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:54.448 INFO:teuthology.orchestra.run.smithi079.stdout:4673 writesame 0xc28594a thru 0xc2930c2 data_size 0x51(0xd779 bytes) 2024-09-21T13:59:54.448 INFO:teuthology.orchestra.run.smithi079.stdout:4674 punch from 0x67444e9 to 0x675258b, (0xe0a2 bytes) 2024-09-21T13:59:54.452 INFO:teuthology.orchestra.run.smithi079.stdout:4675 trunc from 0xc2930c3 to 0x9fb19fc 2024-09-21T13:59:54.464 INFO:teuthology.orchestra.run.smithi079.stdout:4676 read 0x96672ee thru 0x96712b9 (0x9fcc bytes) 2024-09-21T13:59:54.464 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.464 INFO:teuthology.orchestra.run.smithi079.stdout:4679 read 0x4dfc8b7 thru 0x4e046fe (0x7e48 bytes) 2024-09-21T13:59:54.473 INFO:teuthology.orchestra.run.smithi079.stdout:4680 trunc from 0x9fb19fc to 0x4cb281f 2024-09-21T13:59:54.474 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:54.472+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:54.494 INFO:teuthology.orchestra.run.smithi079.stdout:4681 punch from 0x3d0004d to 0x3d0f0df, (0xf092 bytes) 2024-09-21T13:59:54.494 INFO:teuthology.orchestra.run.smithi079.stdout:4682 read 0xaa2192 thru 0xaa886a (0x66d9 bytes) 2024-09-21T13:59:54.495 INFO:teuthology.orchestra.run.smithi079.stdout:4684 read 0x351e681 thru 0x352e462 (0xfde2 bytes) 2024-09-21T13:59:54.504 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:54.504 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:54.504 INFO:teuthology.orchestra.run.smithi079.stdout:4685 trunc from 0x4cb281f to 0xb3cfeae 2024-09-21T13:59:54.511 INFO:teuthology.orchestra.run.smithi079.stdout:4686 read 0x48cee55 thru 0x48dccd8 (0xde84 bytes) 2024-09-21T13:59:54.511 INFO:teuthology.orchestra.run.smithi079.stdout:4687 read 0x2033a8 thru 0x2085c9 (0x5222 bytes) 2024-09-21T13:59:54.512 INFO:teuthology.orchestra.run.smithi079.stdout:4689 read 0x37c491e thru 0x37c8841 (0x3f24 bytes) 2024-09-21T13:59:54.512 INFO:teuthology.orchestra.run.smithi079.stdout:4690 read 0x21b9853 thru 0x21c844c (0xebfa bytes) 2024-09-21T13:59:54.513 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.513 INFO:teuthology.orchestra.run.smithi079.stdout:4693 write 0xa1f22c7 thru 0xa1f547e (0x31b8 bytes) 2024-09-21T13:59:54.520 INFO:teuthology.orchestra.run.smithi079.stdout:4694 write 0x11c305a thru 0x11c9aae (0x6a55 bytes) 2024-09-21T13:59:54.523 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:54.526 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.526 INFO:teuthology.orchestra.run.smithi079.stdout:4697 read 0x4b02b2d thru 0x4b0b99b (0x8e6f bytes) 2024-09-21T13:59:54.532 INFO:teuthology.orchestra.run.smithi079.stdout:4698 trunc from 0xb3cfeae to 0x6d62b60 2024-09-21T13:59:54.541 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:54.541 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:54.544 INFO:teuthology.orchestra.run.smithi079.stdout:4700 read 0x31aeebd thru 0x31bae14 (0xbf58 bytes) 2024-09-21T13:59:54.545 INFO:teuthology.orchestra.run.smithi079.stdout:4702 writesame 0x121b980 thru 0x121e3d5 data_size 0x1(0x2a56 bytes) 2024-09-21T13:59:54.549 INFO:teuthology.orchestra.run.smithi079.stdout:4703 write 0x6e982d thru 0x6f8da1 (0xf575 bytes) 2024-09-21T13:59:54.554 INFO:teuthology.orchestra.run.smithi079.stdout:4706 read 0x5616393 thru 0x56243f6 (0xe064 bytes) 2024-09-21T13:59:54.555 INFO:teuthology.orchestra.run.smithi079.stdout:4707 read 0xe61c3a thru 0xe69b74 (0x7f3b bytes) 2024-09-21T13:59:54.555 INFO:teuthology.orchestra.run.smithi079.stdout:4709 read 0x46235e3 thru 0x4627bfa (0x4618 bytes) 2024-09-21T13:59:54.555 INFO:teuthology.orchestra.run.smithi079.stdout:4710 read 0x26baf00 thru 0x26c793c (0xca3d bytes) 2024-09-21T13:59:54.556 INFO:teuthology.orchestra.run.smithi079.stdout:4711 read 0x4393415 thru 0x4394428 (0x1014 bytes) 2024-09-21T13:59:54.556 INFO:teuthology.orchestra.run.smithi079.stdout:4712 read 0x4aaa766 thru 0x4ab178f (0x702a bytes) 2024-09-21T13:59:54.560 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:54.573 INFO:teuthology.orchestra.run.smithi079.stdout:4713 write 0xe626e2f thru 0xe62b25d (0x442f bytes) 2024-09-21T13:59:54.574 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:54.572+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:54.579 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:54.579 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:54.583 INFO:teuthology.orchestra.run.smithi079.stdout:4715 writesame 0x7229a30 thru 0x722da4a data_size 0x1(0x401b bytes) 2024-09-21T13:59:54.599 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:54.600 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:54.601 INFO:teuthology.orchestra.run.smithi079.stdout:4717 trunc from 0xe62b25e to 0x981914f 2024-09-21T13:59:54.614 INFO:teuthology.orchestra.run.smithi079.stdout:4718 read 0x7f393a2 thru 0x7f3f634 (0x6293 bytes) 2024-09-21T13:59:54.615 INFO:teuthology.orchestra.run.smithi079.stdout:4720 trunc from 0x981914f to 0xa2f6cb8 2024-09-21T13:59:54.617 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:54.617 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:54.619 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:54.620 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:54.621 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:54.622 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:54.623 INFO:teuthology.orchestra.run.smithi079.stdout:4721 punch from 0x1d56035 to 0x1d65bea, (0xfbb5 bytes) 2024-09-21T13:59:54.623 INFO:teuthology.orchestra.run.smithi079.stdout:4722 write 0x8093b7d thru 0x809f9c8 (0xbe4c bytes) 2024-09-21T13:59:54.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:54.644 INFO:teuthology.orchestra.run.smithi079.stdout:4724 punch from 0x3a93988 to 0x3a9e2af, (0xa927 bytes) 2024-09-21T13:59:54.644 INFO:teuthology.orchestra.run.smithi079.stdout:4725 read 0x2110f8 thru 0x21bac1 (0xa9ca bytes) 2024-09-21T13:59:54.646 INFO:teuthology.orchestra.run.smithi079.stdout:4727 read 0x67f1f05 thru 0x67fd19a (0xb296 bytes) 2024-09-21T13:59:54.647 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.655 INFO:teuthology.orchestra.run.smithi079.stdout:4730 write 0xae30061 thru 0xae39c0e (0x9bae bytes) 2024-09-21T13:59:54.669 INFO:teuthology.orchestra.run.smithi079.stdout:4732 write 0x930e7e0 thru 0x931314d (0x496e bytes) 2024-09-21T13:59:54.678 INFO:teuthology.orchestra.run.smithi079.stdout:4733 punch from 0x7020cc3 to 0x7027490, (0x67cd bytes) 2024-09-21T13:59:54.683 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:54.680+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:54.690 INFO:teuthology.orchestra.run.smithi079.stdout:4734 write 0xcbadfa6 thru 0xcbaf966 (0x19c1 bytes) 2024-09-21T13:59:54.703 INFO:teuthology.orchestra.run.smithi079.stdout:4735 trunc from 0xcbaf967 to 0x8511dfd 2024-09-21T13:59:54.718 INFO:teuthology.orchestra.run.smithi079.stdout:4738 read 0xc7b208 thru 0xc7e429 (0x3222 bytes) 2024-09-21T13:59:54.719 INFO:teuthology.orchestra.run.smithi079.stdout:4740 writesame 0x15e8026 thru 0x15e9d6d data_size 0x4(0x1d48 bytes) 2024-09-21T13:59:54.722 INFO:teuthology.orchestra.run.smithi079.stdout:4741 read 0x61f9fe7 thru 0x62099f7 (0xfa11 bytes) 2024-09-21T13:59:54.727 INFO:teuthology.orchestra.run.smithi079.stdout:4743 trunc from 0x8511dfd to 0x4fb7405 2024-09-21T13:59:54.746 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.755 INFO:teuthology.orchestra.run.smithi079.stdout:4745 trunc from 0x4fb7405 to 0xa3d92b 2024-09-21T13:59:54.772 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:54.772 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:54.778 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:54.776+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:54.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:54.801 INFO:teuthology.orchestra.run.smithi079.stdout:4746 read 0x361fa8 thru 0x370ff1 (0xf04a bytes) 2024-09-21T13:59:54.802 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.820 INFO:teuthology.orchestra.run.smithi079.stdout:4748 write 0x48a233d thru 0x48a85f1 (0x62b5 bytes) 2024-09-21T13:59:54.834 INFO:teuthology.orchestra.run.smithi079.stdout:4749 trunc from 0x48a85f2 to 0x508d7f6 2024-09-21T13:59:54.842 INFO:teuthology.orchestra.run.smithi079.stdout:4750 write 0x220688b thru 0x220bc72 (0x53e8 bytes) 2024-09-21T13:59:54.854 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.868 INFO:teuthology.orchestra.run.smithi079.stdout:4752 trunc from 0x508d7f6 to 0xb5477a4 2024-09-21T13:59:54.877 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.877 INFO:teuthology.orchestra.run.smithi079.stdout:4754 read 0x8a05c57 thru 0x8a07c4c (0x1ff6 bytes) 2024-09-21T13:59:54.877 INFO:teuthology.orchestra.run.smithi079.stdout:4755 write 0x782dae6 thru 0x783a712 (0xcc2d bytes) 2024-09-21T13:59:54.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:54.876+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:4756 read 0x586b930 thru 0x587008e (0x475f bytes) 2024-09-21T13:59:54.901 INFO:teuthology.orchestra.run.smithi079.stdout:4758 writesame 0x79f3078 thru 0x79fcccc data_size 0x1(0x9c55 bytes) 2024-09-21T13:59:54.949 INFO:teuthology.orchestra.run.smithi079.stdout:4759 writesame 0xe6fd430 thru 0xe7056be data_size 0xd(0x828f bytes) 2024-09-21T13:59:54.950 INFO:teuthology.orchestra.run.smithi079.stdout:4760 write 0x41a9942 thru 0x41aebe2 (0x52a1 bytes) 2024-09-21T13:59:54.964 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:54.965 INFO:teuthology.orchestra.run.smithi079.stdout:4763 write 0x106ec0c thru 0x10746a6 (0x5a9b bytes) 2024-09-21T13:59:54.967 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:54.967 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:54.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:54.976+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:54.982 INFO:teuthology.orchestra.run.smithi079.stdout:4764 write 0x27f1f71 thru 0x27f80be (0x614e bytes) 2024-09-21T13:59:54.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:4765 write 0x5a92184 thru 0x5a9624f (0x40cc bytes) 2024-09-21T13:59:55.009 INFO:teuthology.orchestra.run.smithi079.stdout:4766 read 0x7e23e0c thru 0x7e2f041 (0xb236 bytes) 2024-09-21T13:59:55.011 INFO:teuthology.orchestra.run.smithi079.stdout:4768 trunc from 0xe7056bf to 0xeb43ee3 2024-09-21T13:59:55.021 INFO:teuthology.orchestra.run.smithi079.stdout:4770 punch from 0xe008e2d to 0xe01642c, (0xd5ff bytes) 2024-09-21T13:59:55.021 INFO:teuthology.orchestra.run.smithi079.stdout:4771 write 0x4bf0898 thru 0x4bf0e0b (0x574 bytes) 2024-09-21T13:59:55.027 INFO:teuthology.orchestra.run.smithi079.stdout:4772 read 0x599830c thru 0x599ca62 (0x4757 bytes) 2024-09-21T13:59:55.028 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.028 INFO:teuthology.orchestra.run.smithi079.stdout:4776 punch from 0x7dfefc8 to 0x7e09190, (0xa1c8 bytes) 2024-09-21T13:59:55.028 INFO:teuthology.orchestra.run.smithi079.stdout:4779 read 0x7cd3ab6 thru 0x7cde93b (0xae86 bytes) 2024-09-21T13:59:55.029 INFO:teuthology.orchestra.run.smithi079.stdout:4780 read 0x824a55c thru 0x824be75 (0x191a bytes) 2024-09-21T13:59:55.029 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.029 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.029 INFO:teuthology.orchestra.run.smithi079.stdout:4783 write 0x5cbdf08 thru 0x5cc34d5 (0x55ce bytes) 2024-09-21T13:59:55.045 INFO:teuthology.orchestra.run.smithi079.stdout:4784 writesame 0xce93a48 thru 0xcea25d5 data_size 0xb(0xeb8e bytes) 2024-09-21T13:59:55.069 INFO:teuthology.orchestra.run.smithi079.stdout:4786 punch from 0xd65fe2b to 0xd668469, (0x863e bytes) 2024-09-21T13:59:55.069 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.070 INFO:teuthology.orchestra.run.smithi079.stdout:4792 trunc from 0xeb43ee3 to 0xe9356f0 2024-09-21T13:59:55.079 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:55.076+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:55.079 INFO:teuthology.orchestra.run.smithi079.stdout:4794 read 0x7003fc9 thru 0x700f7c2 (0xb7fa bytes) 2024-09-21T13:59:55.080 INFO:teuthology.orchestra.run.smithi079.stdout:4795 punch from 0x9f688d3 to 0x9f744ea, (0xbc17 bytes) 2024-09-21T13:59:55.080 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.080 INFO:teuthology.orchestra.run.smithi079.stdout:4797 read 0xcda2407 thru 0xcdafaa4 (0xd69e bytes) 2024-09-21T13:59:55.085 INFO:teuthology.orchestra.run.smithi079.stdout:4798 trunc from 0xe9356f0 to 0xd2df8ce 2024-09-21T13:59:55.096 INFO:teuthology.orchestra.run.smithi079.stdout:4799 write 0xba41085 thru 0xba437af (0x272b bytes) 2024-09-21T13:59:55.105 INFO:teuthology.orchestra.run.smithi079.stdout:4800 writesame 0xaba080c thru 0xabacb60 data_size 0x49(0xc355 bytes) 2024-09-21T13:59:55.124 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:55.124 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:55.130 INFO:teuthology.orchestra.run.smithi079.stdout:4801 write 0x6913e00 thru 0x691a818 (0x6a19 bytes) 2024-09-21T13:59:55.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:55.150 INFO:teuthology.orchestra.run.smithi079.stdout:4802 writesame 0x384fead thru 0x3850491 data_size 0x1(0x5e5 bytes) 2024-09-21T13:59:55.157 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.161 INFO:teuthology.orchestra.run.smithi079.stdout:4804 trunc from 0xd2df8ce to 0xbd35d48 2024-09-21T13:59:55.179 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:55.180+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:55.184 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.207 INFO:teuthology.orchestra.run.smithi079.stdout:4806 trunc from 0xbd35d48 to 0x2cd232a 2024-09-21T13:59:55.280 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:55.280+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:55.290 INFO:teuthology.orchestra.run.smithi079.stdout:4807 write 0xcc3ede3 thru 0xcc42148 (0x3366 bytes) 2024-09-21T13:59:55.306 INFO:teuthology.orchestra.run.smithi079.stdout:4808 write 0xb459120 thru 0xb464987 (0xb868 bytes) 2024-09-21T13:59:55.320 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:55.320 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:55.335 INFO:teuthology.orchestra.run.smithi079.stdout:4810 punch from 0x5381b68 to 0x5386caf, (0x5147 bytes) 2024-09-21T13:59:55.335 INFO:teuthology.orchestra.run.smithi079.stdout:4811 write 0x1bbf505 thru 0x1bc58cb (0x63c7 bytes) 2024-09-21T13:59:55.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:55.352 INFO:teuthology.orchestra.run.smithi079.stdout:4812 write 0x501a1fb thru 0x5028951 (0xe757 bytes) 2024-09-21T13:59:55.378 INFO:teuthology.orchestra.run.smithi079.stdout:4813 writesame 0x690eec5 thru 0x6919534 data_size 0x8(0xa670 bytes) 2024-09-21T13:59:55.387 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:55.384+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:55.402 INFO:teuthology.orchestra.run.smithi079.stdout:4814 write 0x1168a69 thru 0x1176e9a (0xe432 bytes) 2024-09-21T13:59:55.425 INFO:teuthology.orchestra.run.smithi079.stdout:4815 write 0x89cb9b4 thru 0x89d56ed (0x9d3a bytes) 2024-09-21T13:59:55.444 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.444 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.444 INFO:teuthology.orchestra.run.smithi079.stdout:4820 read 0x259023 thru 0x2600be (0x709c bytes) 2024-09-21T13:59:55.445 INFO:teuthology.orchestra.run.smithi079.stdout:4822 punch from 0x93ca704 to 0x93d66bb, (0xbfb7 bytes) 2024-09-21T13:59:55.445 INFO:teuthology.orchestra.run.smithi079.stdout:4824 write 0xc83b32a thru 0xc848f43 (0xdc1a bytes) 2024-09-21T13:59:55.479 INFO:teuthology.orchestra.run.smithi079.stdout:4825 trunc from 0xcc42149 to 0x67e77eb 2024-09-21T13:59:55.479 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:55.479 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:55.481 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:55.480+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:55.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:55.506 INFO:teuthology.orchestra.run.smithi079.stdout:4827 punch from 0x13b10ef to 0x13bcdc6, (0xbcd7 bytes) 2024-09-21T13:59:55.506 INFO:teuthology.orchestra.run.smithi079.stdout:4828 read 0x642f8aa thru 0x6432ee6 (0x363d bytes) 2024-09-21T13:59:55.506 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T13:59:55.516 INFO:teuthology.orchestra.run.smithi079.stdout:4830 trunc from 0x67e77eb to 0x207e748 2024-09-21T13:59:55.559 INFO:teuthology.orchestra.run.smithi079.stdout:4831 writesame 0x8dc5de9 thru 0x8dcf8a3 data_size 0xd(0x9abb bytes) 2024-09-21T13:59:55.559 INFO:teuthology.orchestra.run.smithi079.stdout:4832 read 0x2f895e9 thru 0x2f9300a (0x9a22 bytes) 2024-09-21T13:59:55.574 INFO:teuthology.orchestra.run.smithi079.stdout:4833 writesame 0xde8ef89 thru 0xde96cf8 data_size 0x30(0x7d70 bytes) 2024-09-21T13:59:55.574 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.574 INFO:teuthology.orchestra.run.smithi079.stdout:4836 writesame 0x412520a thru 0x4132d7e data_size 0x3(0xdb75 bytes) 2024-09-21T13:59:55.587 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:55.584+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:55.593 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.593 INFO:teuthology.orchestra.run.smithi079.stdout:4838 writesame 0x85ab2ff thru 0x85b4c85 data_size 0x21(0x9987 bytes) 2024-09-21T13:59:55.614 INFO:teuthology.orchestra.run.smithi079.stdout:4839 trunc from 0xde96cf9 to 0xbaf45c7 2024-09-21T13:59:55.622 INFO:teuthology.orchestra.run.smithi079.stdout:4841 punch from 0xa16590e to 0xa16fb62, (0xa254 bytes) 2024-09-21T13:59:55.622 INFO:teuthology.orchestra.run.smithi079.stdout:4843 write 0x4ed0e3e thru 0x4edfee2 (0xf0a5 bytes) 2024-09-21T13:59:55.645 INFO:teuthology.orchestra.run.smithi079.stdout:4844 trunc from 0xbaf45c7 to 0xea6d0d1 2024-09-21T13:59:55.653 INFO:teuthology.orchestra.run.smithi079.stdout:4845 write 0x48d2166 thru 0x48e145d (0xf2f8 bytes) 2024-09-21T13:59:55.669 INFO:teuthology.orchestra.run.smithi079.stdout:4846 write 0x2df3970 thru 0x2df4035 (0x6c6 bytes) 2024-09-21T13:59:55.673 INFO:teuthology.orchestra.run.smithi079.stdout:4848 write 0x654c9f0 thru 0x654e2b3 (0x18c4 bytes) 2024-09-21T13:59:55.675 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:55.675 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:55.680 INFO:teuthology.orchestra.run.smithi079.stdout:4850 read 0xccfec76 thru 0xccff98b (0xd16 bytes) 2024-09-21T13:59:55.680 INFO:teuthology.orchestra.run.smithi079.stdout:4851 write 0xd542f85 thru 0xd54925c (0x62d8 bytes) 2024-09-21T13:59:55.684 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:55.684+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:55.693 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:55.695 INFO:teuthology.orchestra.run.smithi079.stdout:4852 punch from 0x3dad3de to 0x3db553d, (0x815f bytes) 2024-09-21T13:59:55.695 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.695 INFO:teuthology.orchestra.run.smithi079.stdout:4856 writesame 0x97bcd8a thru 0x97c578e data_size 0x1(0x8a05 bytes) 2024-09-21T13:59:55.717 INFO:teuthology.orchestra.run.smithi079.stdout:4857 writesame 0xac2055c thru 0xac2e653 data_size 0x5c(0xe0f8 bytes) 2024-09-21T13:59:55.734 INFO:teuthology.orchestra.run.smithi079.stdout:4858 writesame 0x7a10cf3 thru 0x7a1174a data_size 0x4(0xa58 bytes) 2024-09-21T13:59:55.738 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.747 INFO:teuthology.orchestra.run.smithi079.stdout:4860 trunc from 0xea6d0d1 to 0x8b39808 2024-09-21T13:59:55.764 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.766 INFO:teuthology.orchestra.run.smithi079.stdout:4862 trunc from 0x8b39808 to 0xa1ea464 2024-09-21T13:59:55.772 INFO:teuthology.orchestra.run.smithi079.stdout:4863 punch from 0x758e8bc to 0x75907ed, (0x1f31 bytes) 2024-09-21T13:59:55.777 INFO:teuthology.orchestra.run.smithi079.stdout:4864 trunc from 0xa1ea464 to 0x73bddae 2024-09-21T13:59:55.784 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:55.780+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:55.804 INFO:teuthology.orchestra.run.smithi079.stdout:4867 write 0xbb67a7f thru 0xbb6f1b6 (0x7738 bytes) 2024-09-21T13:59:55.817 INFO:teuthology.orchestra.run.smithi079.stdout:4869 writesame 0x4d3c325 thru 0x4d43dea data_size 0x23(0x7ac6 bytes) 2024-09-21T13:59:55.821 INFO:teuthology.orchestra.run.smithi079.stdout:4870 read 0x6152688 thru 0x615b8a7 (0x9220 bytes) 2024-09-21T13:59:55.832 INFO:teuthology.orchestra.run.smithi079.stdout:4871 writesame 0xd732002 thru 0xd733926 data_size 0x1(0x1925 bytes) 2024-09-21T13:59:55.832 INFO:teuthology.orchestra.run.smithi079.stdout:4872 write 0x5f9179f thru 0x5f91fe1 (0x843 bytes) 2024-09-21T13:59:55.836 INFO:teuthology.orchestra.run.smithi079.stdout:4873 read 0x1d1dd1e thru 0x1d2747f (0x9762 bytes) 2024-09-21T13:59:55.837 INFO:teuthology.orchestra.run.smithi079.stdout:4874 read 0xb143c6e thru 0xb14b586 (0x7919 bytes) 2024-09-21T13:59:55.837 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.837 INFO:teuthology.orchestra.run.smithi079.stdout:4877 read 0xb5ec2f7 thru 0xb5edb12 (0x181c bytes) 2024-09-21T13:59:55.837 INFO:teuthology.orchestra.run.smithi079.stdout:4878 writesame 0x586b89c thru 0x5871a0c data_size 0x5(0x6171 bytes) 2024-09-21T13:59:55.851 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.862 INFO:teuthology.orchestra.run.smithi079.stdout:4880 trunc from 0xd733927 to 0x7389362 2024-09-21T13:59:55.865 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:55.865 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:55.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T13:59:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:4883 read 0x5c2b9cd thru 0x5c305a8 (0x4bdc bytes) 2024-09-21T13:59:55.883 INFO:teuthology.orchestra.run.smithi079.stdout:4886 read 0x124c3db thru 0x124d8a0 (0x14c6 bytes) 2024-09-21T13:59:55.885 INFO:teuthology.orchestra.run.smithi079.stdout:4887 read 0x3fc69ae thru 0x3fd1050 (0xa6a3 bytes) 2024-09-21T13:59:55.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:55.884+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:55.886 INFO:teuthology.orchestra.run.smithi079.stdout:4888 write 0x1b14bc0 thru 0x1b1809f (0x34e0 bytes) 2024-09-21T13:59:55.898 INFO:teuthology.orchestra.run.smithi079.stdout:4889 writesame 0x4510ae7 thru 0x451e6c0 data_size 0x2(0xdbda bytes) 2024-09-21T13:59:55.928 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.928 INFO:teuthology.orchestra.run.smithi079.stdout:4891 punch from 0x72f6490 to 0x72fc300, (0x5e70 bytes) 2024-09-21T13:59:55.951 INFO:teuthology.orchestra.run.smithi079.stdout:4892 writesame 0xe2389b4 thru 0xe23f0ba data_size 0x19(0x6707 bytes) 2024-09-21T13:59:55.951 INFO:teuthology.orchestra.run.smithi079.stdout:4896 read 0x49de8aa thru 0x49e1071 (0x27c8 bytes) 2024-09-21T13:59:55.951 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:55.951 INFO:teuthology.orchestra.run.smithi079.stdout:4899 read 0x16d94be thru 0x16de591 (0x50d4 bytes) 2024-09-21T13:59:55.952 INFO:teuthology.orchestra.run.smithi079.stdout:4900 write 0x3fdd12 thru 0x409f04 (0xc1f3 bytes) 2024-09-21T13:59:55.957 INFO:teuthology.orchestra.run.smithi079.stdout:4901 write 0x718c7b0 thru 0x719b8b2 (0xf103 bytes) 2024-09-21T13:59:55.986 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:55.984+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:4902 punch from 0x362622a to 0x362adfb, (0x4bd1 bytes) 2024-09-21T13:59:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:4903 read 0xa0e3565 thru 0xa0e723a (0x3cd6 bytes) 2024-09-21T13:59:55.988 INFO:teuthology.orchestra.run.smithi079.stdout:4905 clone 31 order 23 su 4194304 sc 9 2024-09-21T13:59:56.015 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:56.015 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:56.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T13:59:56.087 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:56.084+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:56.188 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:56.188+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:56.195 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:56.195 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:56.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T13:59:56.289 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:56.284+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:56.373 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:56.374 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:56.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T13:59:56.390 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:56.384+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:56.491 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:56.488+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:56.495 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T13:59:56.514 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:56.515 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:56.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T13:59:56.592 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:56.588+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:56.622 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T13:59:56.635 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone30 from 0xe23f0bb (overlap 0xa25ac4) to 0x0 2024-09-21T13:59:56.692 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:56.692+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:56.716 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:56.716 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:56.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T13:59:56.782 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:56.783 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:56.793 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:56.792+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:56.799 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:56.799 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:56.812 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-21T13:59:56.815 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:56.816 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:56.834 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:56.834 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:56.855 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:56.855 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:56.880 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:56.880 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:56.894 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:56.892+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:56.901 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 88.064610215000002, 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T13:59:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.924586774999995, 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T13:59:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T13:59:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.896327769999999, 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T13:59:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.999219225000004, 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T13:59:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.999157756000002, 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T13:59:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T13:59:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.990093780999999, 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T13:59:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T13:59:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.990036020999995, 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.990017429000005, 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T13:59:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.990005091, 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989983355000007, 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T13:59:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989960171999996, 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989939742999994, 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T13:59:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989924944999999, 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T13:59:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989900360999997, 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T13:59:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989883664999994, 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T13:59:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T13:59:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.989861427999998, 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T13:59:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.071573125, 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T13:59:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T13:59:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.902054577000001, 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.538815983000006, 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.2684103899999997, 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:56.997 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:56.998 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:56.998 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:56.999 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:56.999 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:56.999 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:57.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T13:59:57.000 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:56.996+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:57.066 INFO:teuthology.orchestra.run.smithi079.stdout:4906 writesame 0x88652d2 thru 0x8872bb7 data_size 0x1(0xd8e6 bytes) 2024-09-21T13:59:57.099 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:57.096+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:57.132 INFO:teuthology.orchestra.run.smithi079.stdout:4908 trunc from 0xe23f0bb to 0x1d126b4 2024-09-21T13:59:57.191 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4201.0:6 2.1 2.3e6a8311 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:57.187316+0000", 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0051922449999999998, 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052158650000000001, 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "queued for pg", 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4201", 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.134:0/993891115", 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6 2024-09-21T13:59:57.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187316+0000", 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187316+0000", 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187314+0000", 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187323+0000", 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.867e-06 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187338+0000", 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4335000000000001e-05 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:57.187345+0000", 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9800000000000001e-06 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-21T13:59:57.195 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:57.199 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:57.196+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:57.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T13:59:57.217 INFO:teuthology.orchestra.run.smithi079.stdout:4909 trunc from 0x1d126b4 to 0xb701bbd 2024-09-21T13:59:57.224 INFO:teuthology.orchestra.run.smithi079.stdout:4912 writesame 0x878abb1 thru 0x879a9e7 data_size 0x1(0xfe37 bytes) 2024-09-21T13:59:57.286 INFO:teuthology.orchestra.run.smithi079.stdout:4913 trunc from 0xb701bbd to 0x2f0263 2024-09-21T13:59:57.300 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:57.300+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:4916 punch from 0x17deda to 0x1844d7, (0x65fd bytes) 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:4919 punch from 0x5fb60 to 0x6697d, (0x6e1d bytes) 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:4920 read 0x230811 thru 0x23d334 (0xcb24 bytes) 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:4921 punch from 0x2bb61e to 0x2c4964, (0x9346 bytes) 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.329 INFO:teuthology.orchestra.run.smithi079.stdout:4923 read 0x168a18 thru 0x172a83 (0xa06c bytes) 2024-09-21T13:59:57.330 INFO:teuthology.orchestra.run.smithi079.stdout:4924 punch from 0x22d548 to 0x239734, (0xc1ec bytes) 2024-09-21T13:59:57.337 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:57.337 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:57.338 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:57.338 INFO:teuthology.orchestra.run.smithi079.stdout:4926 write 0x574957 thru 0x576ca1 (0x234b bytes) 2024-09-21T13:59:57.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T13:59:57.374 INFO:teuthology.orchestra.run.smithi079.stdout:4928 write 0xb952944 thru 0xb95b95e (0x901b bytes) 2024-09-21T13:59:57.381 INFO:teuthology.orchestra.run.smithi079.stdout:4929 write 0x6a3e61 thru 0x6a5586 (0x1726 bytes) 2024-09-21T13:59:57.383 INFO:teuthology.orchestra.run.smithi079.stdout:4930 punch from 0x1702797 to 0x1702b60, (0x3c9 bytes) 2024-09-21T13:59:57.383 INFO:teuthology.orchestra.run.smithi079.stdout:4931 write 0x21c8d62 thru 0x21d2f35 (0xa1d4 bytes) 2024-09-21T13:59:57.390 INFO:teuthology.orchestra.run.smithi079.stdout:4932 read 0x45242d4 thru 0x452b863 (0x7590 bytes) 2024-09-21T13:59:57.401 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:57.396+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:57.404 INFO:teuthology.orchestra.run.smithi079.stdout:4935 writesame 0xe7cd249 thru 0xe7d4285 data_size 0x1(0x703d bytes) 2024-09-21T13:59:57.419 INFO:teuthology.orchestra.run.smithi079.stdout:4937 trunc from 0xe7d4286 to 0x522dde6 2024-09-21T13:59:57.434 INFO:teuthology.orchestra.run.smithi079.stdout:4938 punch from 0x37965d9 to 0x37a35f3, (0xd01a bytes) 2024-09-21T13:59:57.442 INFO:teuthology.orchestra.run.smithi079.stdout:4939 trunc from 0x522dde6 to 0xac6544a 2024-09-21T13:59:57.449 INFO:teuthology.orchestra.run.smithi079.stdout:4940 writesame 0x1fb0113 thru 0x1fb8225 data_size 0x1(0x8113 bytes) 2024-09-21T13:59:57.469 INFO:teuthology.orchestra.run.smithi079.stdout:4941 write 0x733a0da thru 0x7345211 (0xb138 bytes) 2024-09-21T13:59:57.474 INFO:teuthology.orchestra.run.smithi079.stdout:4945 read 0x184e6cc thru 0x1853363 (0x4c98 bytes) 2024-09-21T13:59:57.474 INFO:teuthology.orchestra.run.smithi079.stdout:4947 writesame 0x22f9412 thru 0x2301ab9 data_size 0x8(0x86a8 bytes) 2024-09-21T13:59:57.477 INFO:teuthology.orchestra.run.smithi079.stdout:4948 write 0x26c7fc4 thru 0x26d61fc (0xe239 bytes) 2024-09-21T13:59:57.495 INFO:teuthology.orchestra.run.smithi079.stdout:4949 writesame 0xc9f68fb thru 0xca06642 data_size 0x14(0xfd48 bytes) 2024-09-21T13:59:57.495 INFO:teuthology.orchestra.run.smithi079.stdout:4950 punch from 0x9ad34ab to 0x9ae0444, (0xcf99 bytes) 2024-09-21T13:59:57.502 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:57.500+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:57.510 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:57.510 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:57.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:57.510 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987547672999995, 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.511 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.515 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987436049999999, 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T13:59:57.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987416226999997, 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T13:59:57.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T13:59:57.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987392048000004, 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T13:59:57.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.529 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987367942999995, 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:57.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987349433999995, 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.534 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.538 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987339692000006, 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T13:59:57.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.543 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987314832999999, 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T13:59:57.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987286155999996, 2024-09-21T13:59:57.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T13:59:57.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T13:59:57.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T13:59:57.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987267337999995, 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.553 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T13:59:57.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987246666999994, 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T13:59:57.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T13:59:57.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987225596000002, 2024-09-21T13:59:57.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T13:59:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T13:59:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987189744000005, 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T13:59:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987157522000004, 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T13:59:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987121881999997, 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T13:59:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T13:59:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987087403999993, 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.987032843999998, 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T13:59:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T13:59:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.986993678999994, 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T13:59:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.986954943000001, 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T13:59:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T13:59:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.986930189999995, 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T13:59:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:57.605 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:57.605 INFO:teuthology.orchestra.run.smithi079.stdout:4951 writesame 0xdccf17c thru 0xdcddaf2 data_size 0x1(0xe977 bytes) 2024-09-21T13:59:57.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T13:59:57.606 INFO:teuthology.orchestra.run.smithi079.stdout:4952 trunc from 0xdcddaf3 to 0x1726f49 2024-09-21T13:59:57.607 INFO:teuthology.orchestra.run.smithi079.stdout:4953 punch from 0x6e4b51 to 0x6f2291, (0xd740 bytes) 2024-09-21T13:59:57.607 INFO:teuthology.orchestra.run.smithi079.stdout:4956 punch from 0x1116d21 to 0x111fec8, (0x91a7 bytes) 2024-09-21T13:59:57.607 INFO:teuthology.orchestra.run.smithi079.stdout:4957 writesame 0x19431af thru 0x19474b8 data_size 0x1(0x430a bytes) 2024-09-21T13:59:57.613 INFO:teuthology.orchestra.run.smithi079.stdout:4958 writesame 0xe1ebf50 thru 0xe1f407f data_size 0x27(0x8130 bytes) 2024-09-21T13:59:57.613 INFO:teuthology.orchestra.run.smithi079.stdout:4959 punch from 0x20b3bc8 to 0x20bd492, (0x98ca bytes) 2024-09-21T13:59:57.613 INFO:teuthology.orchestra.run.smithi079.stdout:4962 write 0x8b3fb25 thru 0x8b449c2 (0x4e9e bytes) 2024-09-21T13:59:57.614 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:57.612+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:57.620 INFO:teuthology.orchestra.run.smithi079.stdout:4964 write 0x8af6061 thru 0x8b03350 (0xd2f0 bytes) 2024-09-21T13:59:57.624 INFO:teuthology.orchestra.run.smithi079.stdout:4965 write 0x6b1f08a thru 0x6b2b3c7 (0xc33e bytes) 2024-09-21T13:59:57.631 INFO:teuthology.orchestra.run.smithi079.stdout:4966 write 0xda8d22b thru 0xda997cf (0xc5a5 bytes) 2024-09-21T13:59:57.647 INFO:teuthology.orchestra.run.smithi079.stdout:4967 write 0xe413bc8 thru 0xe41687d (0x2cb6 bytes) 2024-09-21T13:59:57.654 INFO:teuthology.orchestra.run.smithi079.stdout:4968 punch from 0x90ab8db to 0x90ae0e0, (0x2805 bytes) 2024-09-21T13:59:57.654 INFO:teuthology.orchestra.run.smithi079.stdout:4970 write 0xb5e2399 thru 0xb5e8714 (0x637c bytes) 2024-09-21T13:59:57.660 INFO:teuthology.orchestra.run.smithi079.stdout:4971 read 0xd6a9f15 thru 0xd6ac091 (0x217d bytes) 2024-09-21T13:59:57.660 INFO:teuthology.orchestra.run.smithi079.stdout:4972 punch from 0x23b8220 to 0x23c29b4, (0xa794 bytes) 2024-09-21T13:59:57.660 INFO:teuthology.orchestra.run.smithi079.stdout:4973 write 0x3f85daf thru 0x3f870eb (0x133d bytes) 2024-09-21T13:59:57.667 INFO:teuthology.orchestra.run.smithi079.stdout:4974 read 0x1430e0d thru 0x1440943 (0xfb37 bytes) 2024-09-21T13:59:57.676 INFO:teuthology.orchestra.run.smithi079.stdout:4976 writesame 0xe52ef0f thru 0xe532564 data_size 0x41(0x3656 bytes) 2024-09-21T13:59:57.688 INFO:teuthology.orchestra.run.smithi079.stdout:4977 trunc from 0xe532565 to 0x92bb696 2024-09-21T13:59:57.705 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.705 INFO:teuthology.orchestra.run.smithi079.stdout:4980 read 0x475351f thru 0x476152a (0xe00c bytes) 2024-09-21T13:59:57.705 INFO:teuthology.orchestra.run.smithi079.stdout:4981 read 0x1940ac thru 0x19d9bf (0x9914 bytes) 2024-09-21T13:59:57.706 INFO:teuthology.orchestra.run.smithi079.stdout:4982 punch from 0xfa55fb to 0xfaaa4b, (0x5450 bytes) 2024-09-21T13:59:57.706 INFO:teuthology.orchestra.run.smithi079.stdout:4983 read 0x66e416c thru 0x66e8f71 (0x4e06 bytes) 2024-09-21T13:59:57.706 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.706 INFO:teuthology.orchestra.run.smithi079.stdout:4987 write 0x12f2c58 thru 0x12fcd4e (0xa0f7 bytes) 2024-09-21T13:59:57.708 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:57.708+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:57.710 INFO:teuthology.orchestra.run.smithi079.stdout:4989 writesame 0x67f87d4 thru 0x67f8a87 data_size 0x2(0x2b4 bytes) 2024-09-21T13:59:57.713 INFO:teuthology.orchestra.run.smithi079.stdout:4992 read 0x4a524f9 thru 0x4a5ef7e (0xca86 bytes) 2024-09-21T13:59:57.713 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.727 INFO:teuthology.orchestra.run.smithi079.stdout:4996 writesame 0xcc13cc3 thru 0xcc2076f data_size 0xf(0xcaad bytes) 2024-09-21T13:59:57.727 INFO:teuthology.orchestra.run.smithi079.stdout:4998 punch from 0x5302d01 to 0x53074bc, (0x47bb bytes) 2024-09-21T13:59:57.727 INFO:teuthology.orchestra.run.smithi079.stdout:4999 punch from 0x7c62f69 to 0x7c65d4f, (0x2de6 bytes) 2024-09-21T13:59:57.728 INFO:teuthology.orchestra.run.smithi079.stdout:5001 punch from 0xade9fa9 to 0xadebaed, (0x1b44 bytes) 2024-09-21T13:59:57.728 INFO:teuthology.orchestra.run.smithi079.stdout:5002 writesame 0x8bf58cf thru 0x8c05553 data_size 0x7(0xfc85 bytes) 2024-09-21T13:59:57.736 INFO:teuthology.orchestra.run.smithi079.stdout:5003 punch from 0x9096339 to 0x909b73c, (0x5403 bytes) 2024-09-21T13:59:57.736 INFO:teuthology.orchestra.run.smithi079.stdout:5004 read 0x51d3606 thru 0x51d74df (0x3eda bytes) 2024-09-21T13:59:57.736 INFO:teuthology.orchestra.run.smithi079.stdout:5005 writesame 0x43d5ee0 thru 0x43de2e7 data_size 0x28(0x8408 bytes) 2024-09-21T13:59:57.748 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:57.748 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T13:59:57.748 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:57.753 INFO:teuthology.orchestra.run.smithi079.stdout:5008 trunc from 0xcc20770 to 0x563eeed 2024-09-21T13:59:57.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T13:59:57.775 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.775 INFO:teuthology.orchestra.run.smithi079.stdout:5010 read 0x5225865 thru 0x522614c (0x8e8 bytes) 2024-09-21T13:59:57.775 INFO:teuthology.orchestra.run.smithi079.stdout:5011 punch from 0x300a4c3 to 0x3017026, (0xcb63 bytes) 2024-09-21T13:59:57.775 INFO:teuthology.orchestra.run.smithi079.stdout:5012 punch from 0x146628d to 0x146ae11, (0x4b84 bytes) 2024-09-21T13:59:57.775 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.790 INFO:teuthology.orchestra.run.smithi079.stdout:5014 write 0x9b31228 thru 0x9b408e8 (0xf6c1 bytes) 2024-09-21T13:59:57.794 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.794 INFO:teuthology.orchestra.run.smithi079.stdout:5016 read 0x58b5435 thru 0x58bad83 (0x594f bytes) 2024-09-21T13:59:57.794 INFO:teuthology.orchestra.run.smithi079.stdout:5017 write 0x5b1a38 thru 0x5c180c (0xfdd5 bytes) 2024-09-21T13:59:57.796 INFO:teuthology.orchestra.run.smithi079.stdout:5019 write 0x9303dec thru 0x930df0d (0xa122 bytes) 2024-09-21T13:59:57.799 INFO:teuthology.orchestra.run.smithi079.stdout:5022 write 0x8ea0d45 thru 0x8eae90b (0xdbc7 bytes) 2024-09-21T13:59:57.804 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:59:57.800+0000 7f74309577c0 -1 osd.7 43 log_to_monitors true 2024-09-21T13:59:57.810 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:57.808+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:57.814 INFO:teuthology.orchestra.run.smithi079.stdout:5023 writesame 0xc5fda5f thru 0xc603378 data_size 0x5(0x591a bytes) 2024-09-21T13:59:57.814 INFO:teuthology.orchestra.run.smithi079.stdout:5024 read 0x6f02b48 thru 0x6f059e7 (0x2ea0 bytes) 2024-09-21T13:59:57.814 INFO:teuthology.orchestra.run.smithi079.stdout:5025 writesame 0xc27fa00 thru 0xc286ccc data_size 0x1(0x72cd bytes) 2024-09-21T13:59:57.839 INFO:teuthology.orchestra.run.smithi079.stdout:5027 read 0x88db234 thru 0x88e29cf (0x779c bytes) 2024-09-21T13:59:57.839 INFO:teuthology.orchestra.run.smithi079.stdout:5028 punch from 0x1d7bd00 to 0x1d84113, (0x8413 bytes) 2024-09-21T13:59:57.839 INFO:teuthology.orchestra.run.smithi079.stdout:5032 read 0x53af91e thru 0x53b4c6a (0x534d bytes) 2024-09-21T13:59:57.841 INFO:teuthology.orchestra.run.smithi079.stdout:5034 trunc from 0xc603379 to 0xde0f41c 2024-09-21T13:59:57.848 INFO:teuthology.orchestra.run.smithi079.stdout:5036 write 0x8c44be0 thru 0x8c4cc8e (0x80af bytes) 2024-09-21T13:59:57.850 INFO:teuthology.orchestra.run.smithi079.stdout:5037 write 0x112ad2c thru 0x113618d (0xb462 bytes) 2024-09-21T13:59:57.852 INFO:teuthology.orchestra.run.smithi079.stdout:5039 punch from 0x241e7f7 to 0x2428dcb, (0xa5d4 bytes) 2024-09-21T13:59:57.864 INFO:teuthology.orchestra.run.smithi079.stdout:5040 trunc from 0xde0f41c to 0x51ddf03 2024-09-21T13:59:57.888 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.888 INFO:teuthology.orchestra.run.smithi079.stdout:5043 read 0x2c63465 thru 0x2c733b1 (0xff4d bytes) 2024-09-21T13:59:57.898 INFO:teuthology.orchestra.run.smithi079.stdout:5044 write 0x6c51bbf thru 0x6c56b76 (0x4fb8 bytes) 2024-09-21T13:59:57.904 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T13:59:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T13:59:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T13:59:57.904 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:57.911 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:57.908+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:57.916 INFO:teuthology.orchestra.run.smithi079.stdout:5045 write 0xa16381b thru 0xa169db1 (0x6597 bytes) 2024-09-21T13:59:57.920 INFO:teuthology.orchestra.run.smithi079.stdout:5046 read 0x9b450c1 thru 0x9b50b28 (0xba68 bytes) 2024-09-21T13:59:57.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T13:59:57.927 INFO:teuthology.orchestra.run.smithi079.stdout:5048 trunc from 0xa169db2 to 0x617e47f 2024-09-21T13:59:57.943 INFO:teuthology.orchestra.run.smithi079.stdout:5049 read 0x1b1093a thru 0x1b14507 (0x3bce bytes) 2024-09-21T13:59:57.944 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.944 INFO:teuthology.orchestra.run.smithi079.stdout:5051 write 0x40bc371 thru 0x40ca149 (0xddd9 bytes) 2024-09-21T13:59:57.947 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.948 INFO:teuthology.orchestra.run.smithi079.stdout:5053 write 0x3db67af thru 0x3dbf4ff (0x8d51 bytes) 2024-09-21T13:59:57.951 INFO:teuthology.orchestra.run.smithi079.stdout:5054 read 0x91e80e thru 0x923fb6 (0x57a9 bytes) 2024-09-21T13:59:57.952 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:57.952 INFO:teuthology.orchestra.run.smithi079.stdout:5057 write 0x537110f thru 0x537ee1d (0xdd0f bytes) 2024-09-21T13:59:57.957 INFO:teuthology.orchestra.run.smithi079.stdout:5058 read 0x3fbf5c6 thru 0x3fcba40 (0xc47b bytes) 2024-09-21T13:59:57.958 INFO:teuthology.orchestra.run.smithi079.stdout:5060 read 0x205a674 thru 0x205dfa3 (0x3930 bytes) 2024-09-21T13:59:57.958 INFO:teuthology.orchestra.run.smithi079.stdout:5061 punch from 0x148c5b to 0x1533ed, (0xa792 bytes) 2024-09-21T13:59:57.958 INFO:teuthology.orchestra.run.smithi079.stdout:5062 read 0x35b1b43 thru 0x35b62d7 (0x4795 bytes) 2024-09-21T13:59:57.982 INFO:teuthology.orchestra.run.smithi079.stdout:5063 write 0xe52aa5b thru 0xe537afb (0xd0a1 bytes) 2024-09-21T13:59:57.989 INFO:teuthology.orchestra.run.smithi079.stdout:5064 write 0x367f284 thru 0x367f7e3 (0x560 bytes) 2024-09-21T13:59:57.992 INFO:teuthology.orchestra.run.smithi079.stdout:5065 writesame 0x1ca833b thru 0x1cb1c8a data_size 0x58(0x9950 bytes) 2024-09-21T13:59:57.996 INFO:teuthology.orchestra.run.smithi079.stdout:5066 writesame 0xb760ab9 thru 0xb7615c2 data_size 0x9(0xb0a bytes) 2024-09-21T13:59:58.001 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.012 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:58.008+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:58.013 INFO:teuthology.orchestra.run.smithi079.stdout:5069 trunc from 0xe537afc to 0x8628295 2024-09-21T13:59:58.044 INFO:teuthology.orchestra.run.smithi079.stdout:5070 trunc from 0x8628295 to 0x4d758b6 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.649646880999995, 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T13:59:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.609560043000002, 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T13:59:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T13:59:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T13:59:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.548246786999997, 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T13:59:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.083787849, 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T13:59:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.08374057, 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T13:59:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T13:59:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.083701068, 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T13:59:58.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T13:59:58.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 10.083662008999999, 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T13:59:58.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T13:59:58.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.087 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5552983509999994, 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.088 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T13:59:58.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T13:59:58.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5552706609999998, 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5552481749999991, 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T13:59:58.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T13:59:58.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T13:59:58.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T13:59:58.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.103 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5552010620000001, 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T13:59:58.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5551804160000007, 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T13:59:58.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T13:59:58.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5551561249999999, 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T13:59:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T13:59:58.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5551356219999999, 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.121 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5551133079999993, 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T13:59:58.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5550951229999992, 2024-09-21T13:59:58.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T13:59:58.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T13:59:58.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5550766429999996, 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T13:59:58.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5550309749999993, 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.139 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5550062540000003, 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:58.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T13:59:58.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.5549871399999997, 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.144 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T13:59:58.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T13:59:58.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T13:59:58.148 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T13:59:58.150 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5071 writesame 0x86abe70 thru 0x86b38f7 data_size 0xc(0x7a88 bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5073 writesame 0xec4e9f2 thru 0xec5e86e data_size 0x29(0xfe7d bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5077 write 0x991ac6d thru 0x9923774 (0x8b08 bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5078 read 0xb4550f0 thru 0xb461077 (0xbf88 bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5079 writesame 0x41849a8 thru 0x418e194 data_size 0x17(0x97ed bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5080 writesame 0xe9c8dce thru 0xe9d8818 data_size 0x37(0xfa4b bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5081 write 0x14e669e thru 0x14f08b7 (0xa21a bytes) 2024-09-21T13:59:58.151 INFO:teuthology.orchestra.run.smithi079.stdout:5082 writesame 0x3cb98b4 thru 0x3cc91d7 data_size 0x1e(0xf924 bytes) 2024-09-21T13:59:58.152 INFO:teuthology.orchestra.run.smithi079.stdout:5083 writesame 0x8284ef0 thru 0x829412c data_size 0x7(0xf23d bytes) 2024-09-21T13:59:58.152 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:58.144+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:58.156 INFO:teuthology.orchestra.run.smithi079.stdout:5086 read 0x7f79598 thru 0x7f854ae (0xbf17 bytes) 2024-09-21T13:59:58.156 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.156 INFO:teuthology.orchestra.run.smithi079.stdout:5088 writesame 0x90ffb87 thru 0x910000e data_size 0xa(0x488 bytes) 2024-09-21T13:59:58.193 INFO:teuthology.orchestra.run.smithi079.stdout:5089 trunc from 0xec5e86f to 0x35f3fcc 2024-09-21T13:59:58.216 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.216 INFO:teuthology.orchestra.run.smithi079.stdout:5094 write 0x12c87 thru 0x178c2 (0x4c3c bytes) 2024-09-21T13:59:58.220 INFO:teuthology.orchestra.run.smithi079.stdout:5095 read 0xbf0446 thru 0xbfee66 (0xea21 bytes) 2024-09-21T13:59:58.250 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T13:59:58.248+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T13:59:58.253 INFO:teuthology.orchestra.run.smithi079.stdout:5096 writesame 0xb3d78eb thru 0xb3e68e6 data_size 0x2(0xeffc bytes) 2024-09-21T13:59:58.253 INFO:teuthology.orchestra.run.smithi079.stdout:5097 write 0x5eef516 thru 0x5ef3e33 (0x491e bytes) 2024-09-21T13:59:58.260 INFO:teuthology.orchestra.run.smithi079.stdout:5099 read 0x2170b95 thru 0x2176b22 (0x5f8e bytes) 2024-09-21T13:59:58.260 INFO:teuthology.orchestra.run.smithi079.stdout:5101 read 0x19fef5 thru 0x1a35b0 (0x36bc bytes) 2024-09-21T13:59:58.261 INFO:teuthology.orchestra.run.smithi079.stdout:5102 punch from 0x46d8ba2 to 0x46dbce3, (0x3141 bytes) 2024-09-21T13:59:58.261 INFO:teuthology.orchestra.run.smithi079.stdout:5104 read 0x41deda9 thru 0x41ec142 (0xd39a bytes) 2024-09-21T13:59:58.264 INFO:teuthology.orchestra.run.smithi079.stdout:5105 trunc from 0xb3e68e7 to 0xaa3d423 2024-09-21T13:59:58.284 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:58.285 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:58.285 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:58.285 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:58.290 INFO:teuthology.orchestra.run.smithi079.stdout:5106 writesame 0xb8a824b thru 0xb8aeba9 data_size 0x19(0x695f bytes) 2024-09-21T13:59:58.290 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.290 INFO:teuthology.orchestra.run.smithi079.stdout:5108 punch from 0x1cae84a to 0x1cb119d, (0x2953 bytes) 2024-09-21T13:59:58.290 INFO:teuthology.orchestra.run.smithi079.stdout:5109 read 0x1580621 thru 0x15848b9 (0x4299 bytes) 2024-09-21T13:59:58.291 INFO:teuthology.orchestra.run.smithi079.stdout:5110 read 0x2f8527f thru 0x2f86e61 (0x1be3 bytes) 2024-09-21T13:59:58.291 INFO:teuthology.orchestra.run.smithi079.stdout:5111 read 0x472d18b thru 0x473a71e (0xd594 bytes) 2024-09-21T13:59:58.291 INFO:teuthology.orchestra.run.smithi079.stdout:5112 read 0x2591176 thru 0x259deee (0xcd79 bytes) 2024-09-21T13:59:58.292 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:58.292 INFO:teuthology.orchestra.run.smithi079.stdout:5115 read 0x73955b7 thru 0x73a1f7e (0xc9c8 bytes) 2024-09-21T13:59:58.292 INFO:teuthology.orchestra.run.smithi079.stdout:5116 read 0x39f4c0 thru 0x3a7a00 (0x8541 bytes) 2024-09-21T13:59:58.293 INFO:teuthology.orchestra.run.smithi079.stdout:5117 trunc from 0xb8aebaa to 0xb508c95 2024-09-21T13:59:58.299 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T13:59:58.306 INFO:teuthology.orchestra.run.smithi079.stdout:5119 read 0x740a318 thru 0x740e15e (0x3e47 bytes) 2024-09-21T13:59:58.306 INFO:teuthology.orchestra.run.smithi079.stdout:5120 read 0x8721fdb thru 0x8729e02 (0x7e28 bytes) 2024-09-21T13:59:58.324 INFO:teuthology.orchestra.run.smithi079.stdout:5121 write 0xe4af9f4 thru 0xe4b5dd4 (0x63e1 bytes) 2024-09-21T13:59:58.329 INFO:teuthology.orchestra.run.smithi079.stdout:5122 read 0xd13d975 thru 0xd14713c (0x97c8 bytes) 2024-09-21T13:59:58.329 INFO:teuthology.orchestra.run.smithi079.stdout:5123 read 0x52be21 thru 0x53a3e9 (0xe5c9 bytes) 2024-09-21T13:59:58.330 INFO:teuthology.orchestra.run.smithi079.stdout:5124 write 0x9eb8532 thru 0x9ebcad6 (0x45a5 bytes) 2024-09-21T13:59:58.336 INFO:teuthology.orchestra.run.smithi079.stdout:5125 clone 32 order 20 su 65536 sc 2 2024-09-21T13:59:58.351 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:58.348+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:58.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T13:59:58.453 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:58.452+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:58.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T13:59:58.557 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:59:58.552+0000 7f742471e640 -1 osd.7 93 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T13:59:58.564 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:58.564+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:58.618 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.728202146000001, 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T13:59:58.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T13:59:58.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.728166916999999, 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T13:59:58.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T13:59:58.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.728141548, 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T13:59:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.728101005999999, 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T13:59:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:58.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T13:59:58.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.728060173999999, 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T13:59:58.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.619336425, 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.619312752999999, 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T13:59:58.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T13:59:58.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T13:59:58.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.013849187999998, 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T13:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T13:59:58.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T13:59:58.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:58.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863634179999995, 2024-09-21T13:59:58.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863482229999999, 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T13:59:58.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T13:59:58.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863382910000006, 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863287449999994, 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T13:59:58.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T13:59:58.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T13:59:58.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863194230000008, 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.670 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T13:59:58.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0863091740000002, 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.678 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0853190440000002, 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T13:59:58.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T13:59:58.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0852886129999995, 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T13:59:58.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T13:59:58.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0852755139999992, 2024-09-21T13:59:58.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T13:59:58.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T13:59:58.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0852656780000007, 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0811619639999996, 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T13:59:58.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.0811430400000006, 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:58.700 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:58.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:58.704 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:58.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:59:58.705 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone31 from 0xe4b5dd5 (overlap 0x2f0263) to 0x4b370 2024-09-21T13:59:58.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T13:59:58.707 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:58.700+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:58.760 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-21T13:59:58.764 INFO:teuthology.orchestra.run.smithi079.stdout:5127 writesame 0x3ccaf61 thru 0x3cd96bd data_size 0x3(0xe75d bytes) 2024-09-21T13:59:58.790 INFO:teuthology.orchestra.run.smithi079.stdout:5128 writesame 0x8cd9290 thru 0x8ce87fe data_size 0x1(0xf56f bytes) 2024-09-21T13:59:58.806 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:58.804+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:58.827 INFO:teuthology.orchestra.run.smithi079.stdout:5129 read 0x5348100 thru 0x5351127 (0x9028 bytes) 2024-09-21T13:59:58.827 INFO:teuthology.orchestra.run.smithi079.stdout:5131 write 0x44e268c thru 0x44e8099 (0x5a0e bytes) 2024-09-21T13:59:58.832 INFO:teuthology.orchestra.run.smithi079.stdout:5132 writesame 0x9189b9b thru 0x9195e29 data_size 0x1(0xc28f bytes) 2024-09-21T13:59:58.864 INFO:teuthology.orchestra.run.smithi079.stdout:5134 trunc from 0xe4b5dd5 to 0xb4f84c1 2024-09-21T13:59:58.887 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:58.887 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:58.887 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:58.887 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:58.888 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:58.888 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:58.889 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T13:59:58.889 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:58.903 INFO:teuthology.orchestra.run.smithi079.stdout:5135 write 0xeb408ec thru 0xeb4beae (0xb5c3 bytes) 2024-09-21T13:59:58.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T13:59:58.908 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T13:59:58.904+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T13:59:58.909 INFO:teuthology.orchestra.run.smithi079.stdout:5137 read 0x41f6acc thru 0x4203fa7 (0xd4dc bytes) 2024-09-21T13:59:58.910 INFO:teuthology.orchestra.run.smithi079.stdout:5138 writesame 0x3d5c5cd thru 0x3d62a90 data_size 0x2(0x64c4 bytes) 2024-09-21T13:59:58.923 INFO:teuthology.orchestra.run.smithi079.stdout:5139 read 0xc6e03d6 thru 0xc6ec2da (0xbf05 bytes) 2024-09-21T13:59:58.924 INFO:teuthology.orchestra.run.smithi079.stdout:5141 punch from 0x3fd5c78 to 0x3fe559f, (0xf927 bytes) 2024-09-21T13:59:58.924 INFO:teuthology.orchestra.run.smithi079.stdout:5142 writesame 0xe833e3a thru 0xe83a30b data_size 0x59(0x64d2 bytes) 2024-09-21T13:59:58.928 INFO:teuthology.orchestra.run.smithi079.stdout:5143 read 0x99fa1a0 thru 0x9a063cf (0xc230 bytes) 2024-09-21T13:59:58.930 INFO:teuthology.orchestra.run.smithi079.stdout:5145 flatten 2024-09-21T13:59:59.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T13:59:59.044 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T13:59:59.044+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T13:59:59.047 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:59.047 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T13:59:59.047 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T13:59:59.047 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T13:59:59.047 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:59.055 INFO:teuthology.orchestra.run.smithi079.stdout:5146 punch from 0x685f570 to 0x686cfb1, (0xda41 bytes) 2024-09-21T13:59:59.056 INFO:teuthology.orchestra.run.smithi079.stdout:5147 write 0x29a165c thru 0x29a32ea (0x1c8f bytes) 2024-09-21T13:59:59.059 INFO:teuthology.orchestra.run.smithi079.stdout:5148 read 0x3ecf2cf thru 0x3edd0cb (0xddfd bytes) 2024-09-21T13:59:59.059 INFO:teuthology.orchestra.run.smithi079.stdout:5149 writesame 0xc29fe71 thru 0xc2a9618 data_size 0x17(0x97a8 bytes) 2024-09-21T13:59:59.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T13:59:59.064 INFO:teuthology.orchestra.run.smithi079.stdout:5150 write 0xea9b37c thru 0xeaa3b98 (0x881d bytes) 2024-09-21T13:59:59.067 INFO:teuthology.orchestra.run.smithi079.stdout:5152 write 0xd197a1e thru 0xd1a7a02 (0xffe5 bytes) 2024-09-21T13:59:59.072 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.072 INFO:teuthology.orchestra.run.smithi079.stdout:5155 write 0x3c81bbe thru 0x3c89605 (0x7a48 bytes) 2024-09-21T13:59:59.073 INFO:teuthology.orchestra.run.smithi079.stdout:5156 write 0x325238f thru 0x325370a (0x137c bytes) 2024-09-21T13:59:59.077 INFO:teuthology.orchestra.run.smithi079.stdout:5157 write 0xd8d2922 thru 0xd8d5258 (0x2937 bytes) 2024-09-21T13:59:59.081 INFO:teuthology.orchestra.run.smithi079.stdout:5159 read 0xd7d5fed thru 0xd7e57cd (0xf7e1 bytes) 2024-09-21T13:59:59.081 INFO:teuthology.orchestra.run.smithi079.stdout:5165 write 0x4e33936 thru 0x4e33ceb (0x3b6 bytes) 2024-09-21T13:59:59.085 INFO:teuthology.orchestra.run.smithi079.stdout:5166 read 0x5d734c1 thru 0x5d7a4fb (0x703b bytes) 2024-09-21T13:59:59.085 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.085 INFO:teuthology.orchestra.run.smithi079.stdout:5169 write 0xc3c82c9 thru 0xc3d1da3 (0x9adb bytes) 2024-09-21T13:59:59.087 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.087 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.087 INFO:teuthology.orchestra.run.smithi079.stdout:5172 write 0xd417c55 thru 0xd41e145 (0x64f1 bytes) 2024-09-21T13:59:59.092 INFO:teuthology.orchestra.run.smithi079.stdout:5173 write 0xadb26ed thru 0xadbe51e (0xbe32 bytes) 2024-09-21T13:59:59.104 INFO:teuthology.orchestra.run.smithi079.stdout:5174 trunc from 0xeb4beaf to 0x952f025 2024-09-21T13:59:59.111 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:59.108+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:59.119 INFO:teuthology.orchestra.run.smithi079.stdout:5175 trunc from 0x952f025 to 0x9fa65f8 2024-09-21T13:59:59.136 INFO:teuthology.orchestra.run.smithi079.stdout:5176 write 0xdd9f627 thru 0xdda26d0 (0x30aa bytes) 2024-09-21T13:59:59.143 INFO:teuthology.orchestra.run.smithi079.stdout:5178 write 0x13d8342 thru 0x13e7b48 (0xf807 bytes) 2024-09-21T13:59:59.146 INFO:teuthology.orchestra.run.smithi079.stdout:5179 writesame 0xa39c2c7 thru 0xa3aa65b data_size 0x31(0xe395 bytes) 2024-09-21T13:59:59.159 INFO:teuthology.orchestra.run.smithi079.stdout:5182 write 0xe5af667 thru 0xe5bd88d (0xe227 bytes) 2024-09-21T13:59:59.161 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T13:59:59.161 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T13:59:59.163 INFO:teuthology.orchestra.run.smithi079.stdout:5183 read 0x2325bd4 thru 0x232f20a (0x9637 bytes) 2024-09-21T13:59:59.163 INFO:teuthology.orchestra.run.smithi079.stdout:5184 punch from 0xa0c553a to 0xa0d2dfb, (0xd8c1 bytes) 2024-09-21T13:59:59.163 INFO:teuthology.orchestra.run.smithi079.stdout:5187 writesame 0xbaae84c thru 0xbabcd20 data_size 0x45(0xe4d5 bytes) 2024-09-21T13:59:59.168 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.179 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T13:59:59.179 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T13:59:59.184 INFO:teuthology.orchestra.run.smithi079.stdout:5191 trunc from 0xe5bd88e to 0x38746a4 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703301142000001, 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T13:59:59.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T13:59:59.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T13:59:59.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703253033999999, 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T13:59:59.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T13:59:59.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703190826, 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.195 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703142577000001, 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T13:59:59.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T13:59:59.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703097229000001, 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T13:59:59.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703050777000001, 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T13:59:59.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.703004998000001, 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T13:59:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T13:59:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.70295994, 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T13:59:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702915481000002, 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702863093000001, 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T13:59:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T13:59:59.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.70283001, 2024-09-21T13:59:59.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T13:59:59.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.234 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702745083, 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:59.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T13:59:59.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T13:59:59.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702698013999999, 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702652819000001, 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T13:59:59.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.702595213999999, 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T13:59:59.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.251 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.701159425, 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T13:59:59.255 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.701081303999999, 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T13:59:59.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T13:59:59.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.701032051999999, 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T13:59:59.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T13:59:59.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6809332220000002, 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T13:59:59.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3909100930000005, 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T13:59:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.274 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:59.275 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T13:59:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T13:59:59.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.276 INFO:teuthology.orchestra.run.smithi079.stdout:5194 writesame 0x22534e1 thru 0x225a929 data_size 0x1(0x7449 bytes) 2024-09-21T13:59:59.276 INFO:teuthology.orchestra.run.smithi079.stdout:5195 read 0x14f6195 thru 0x1503987 (0xd7f3 bytes) 2024-09-21T13:59:59.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T13:59:59.277 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T13:59:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T13:59:59.278 INFO:teuthology.orchestra.run.smithi079.stdout:5198 write 0xb3fbf95 thru 0xb40524c (0x92b8 bytes) 2024-09-21T13:59:59.278 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T13:59:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T13:59:59.278 INFO:teuthology.orchestra.run.smithi079.stdout:5199 write 0x2f22400 thru 0x2f2f23c (0xce3d bytes) 2024-09-21T13:59:59.279 INFO:teuthology.orchestra.run.smithi079.stdout:5200 write 0x531be00 thru 0x5321680 (0x5881 bytes) 2024-09-21T13:59:59.279 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T13:59:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T13:59:59.279 INFO:teuthology.orchestra.run.smithi079.stdout:5201 write 0xe7a8834 thru 0xe7aad46 (0x2513 bytes) 2024-09-21T13:59:59.280 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.280 INFO:teuthology.orchestra.run.smithi079.stdout:5203 writesame 0x449025b thru 0x449f05b data_size 0x1d(0xee01 bytes) 2024-09-21T13:59:59.280 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T13:59:59.280 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T13:59:59.275+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T13:59:59.280 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T13:59:59.281 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T13:59:59.281 INFO:teuthology.orchestra.run.smithi079.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-21T13:59:59.283 INFO:teuthology.orchestra.run.smithi079.stdout:5205 trunc from 0xe7aad47 to 0x5c3fad0 2024-09-21T13:59:59.284 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-21T13:59:59.284 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-21T13:59:59.324 INFO:teuthology.orchestra.run.smithi079.stdout:5209 write 0xd6b8628 thru 0xd6bc38c (0x3d65 bytes) 2024-09-21T13:59:59.330 INFO:teuthology.orchestra.run.smithi079.stdout:5212 read 0x3c1ebd3 thru 0x3c24c91 (0x60bf bytes) 2024-09-21T13:59:59.330 INFO:teuthology.orchestra.run.smithi079.stdout:5214 writesame 0x6437214 thru 0x643891a data_size 0xf(0x1707 bytes) 2024-09-21T13:59:59.334 INFO:teuthology.orchestra.run.smithi079.stdout:5219 write 0x1b5f4ac thru 0x1b64449 (0x4f9e bytes) 2024-09-21T13:59:59.341 INFO:teuthology.orchestra.run.smithi079.stdout:5220 writesame 0x67212cb thru 0x6725da5 data_size 0x1(0x4adb bytes) 2024-09-21T13:59:59.358 INFO:teuthology.orchestra.run.smithi079.stdout:5221 write 0x7848ee8 thru 0x7853970 (0xaa89 bytes) 2024-09-21T13:59:59.365 INFO:teuthology.orchestra.run.smithi079.stdout:5222 write 0x814793a thru 0x8153d4d (0xc414 bytes) 2024-09-21T13:59:59.371 INFO:teuthology.orchestra.run.smithi079.stdout:5223 read 0x2e395bd thru 0x2e40f97 (0x79db bytes) 2024-09-21T13:59:59.373 INFO:teuthology.orchestra.run.smithi079.stdout:5224 trunc from 0xd6bc38d to 0xd22a441 2024-09-21T13:59:59.376 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:59.375+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:59.389 INFO:teuthology.orchestra.run.smithi079.stdout:5225 read 0x611973d thru 0x611be3d (0x2701 bytes) 2024-09-21T13:59:59.402 INFO:teuthology.orchestra.run.smithi079.stdout:5227 write 0xe451d91 thru 0xe4554ad (0x371d bytes) 2024-09-21T13:59:59.408 INFO:teuthology.orchestra.run.smithi079.stdout:5229 read 0x2c85352 thru 0x2c930bb (0xdd6a bytes) 2024-09-21T13:59:59.408 INFO:teuthology.orchestra.run.smithi079.stdout:5231 read 0xa78d094 thru 0xa79a155 (0xd0c2 bytes) 2024-09-21T13:59:59.408 INFO:teuthology.orchestra.run.smithi079.stdout:5233 writesame 0x63aadf6 thru 0x63ace63 data_size 0x7(0x206e bytes) 2024-09-21T13:59:59.414 INFO:teuthology.orchestra.run.smithi079.stdout:5234 punch from 0x350b818 to 0x3515665, (0x9e4d bytes) 2024-09-21T13:59:59.414 INFO:teuthology.orchestra.run.smithi079.stdout:5235 write 0x3541182 thru 0x354417f (0x2ffe bytes) 2024-09-21T13:59:59.422 INFO:teuthology.orchestra.run.smithi079.stdout:5237 writesame 0x36b76f1 thru 0x36bb68b data_size 0x1(0x3f9b bytes) 2024-09-21T13:59:59.441 INFO:teuthology.orchestra.run.smithi079.stdout:5239 punch from 0x74a7b75 to 0x74b13fe, (0x9889 bytes) 2024-09-21T13:59:59.441 INFO:teuthology.orchestra.run.smithi079.stdout:5240 writesame 0xa546273 thru 0xa54da35 data_size 0x1(0x77c3 bytes) 2024-09-21T13:59:59.459 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:59.459 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:59.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T13:59:59.477 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:59:59.472+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T13:59:59.484 INFO:teuthology.orchestra.run.smithi079.stdout:5241 trunc from 0xe4554ae to 0xd408764 2024-09-21T13:59:59.502 INFO:teuthology.orchestra.run.smithi079.stdout:5244 punch from 0x19f4f50 to 0x19fb636, (0x66e6 bytes) 2024-09-21T13:59:59.525 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T13:59:59.577 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T13:59:59.572+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T13:59:59.605 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:59.605 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:59.619 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T13:59:59.707 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:59.704+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:59.779 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T13:59:59.776+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T13:59:59.783 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T13:59:59.783 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T13:59:59.797 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T13:59:59.880 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T13:59:59.879+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T13:59:59.964 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.44714820799999999, 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.44719543099999998, 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T13:59:59.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:59.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.447080423, 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.44725310499999998, 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T13:59:59.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T13:59:59.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.44704604999999997, 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.44732579500000003, 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T13:59:59.973 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T13:59:59.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-09-21T13:59:59.977 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T13:59:59.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T13:59:59.982 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T13:59:59.976+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:00.082 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:00.079+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:00.096 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:00.096 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:00.096 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:00.096 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:00.096 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:00.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:00.183 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:00.180+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:00.232 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:00.232 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:00.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:00.232 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [] 2024-09-21T14:00:00.232 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:00.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:00.292 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:00.291+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:00.380 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:00.380 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:00.385 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:00.383+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:00.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:00.485 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:00.480+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:00.568 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:00.568 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:00.582 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:00.585 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:00.580+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:00.686 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:00.684+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:00.703 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:00.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:00.787 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:00.784+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:00.838 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:00.838 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:00.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:00.888 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:00.884+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:00.970 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:00.970 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:00.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:01.027 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:01.027+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:01.090 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:01.087+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:01.104 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:01.104 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:01.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:01.191 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:01.184+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:01.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:01.287 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:01.287 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:01.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:01.302 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:01.299+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:01.392 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:01.391+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:01.431 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:01.431 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:01.447 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:01.447 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:01.463 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:01.463 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:01.465 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:01.465 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:01.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:01.480 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:01.480 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:01.494 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:01.488+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:01.500 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:01.527 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:01.527 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:01.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:00:01.549 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:01.549 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:01.570 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:01.570 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-21T14:00:01.594 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:01.588+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:01.624 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102390885999995, 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102279263, 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102259439999997, 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102235261000004, 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102211155999996, 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102192646999995, 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102182905000006, 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102158046, 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102129368999996, 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102110550999996, 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102089879999994, 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102068809000002, 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102032957000006, 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.102000735000004, 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101965094999997, 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:01.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101930616999994, 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101876056999998, 2024-09-21T14:00:01.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101836891999994, 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:01.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:01.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101798156000001, 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:01.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:01.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.101773402999996, 2024-09-21T14:00:01.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:01.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:01.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:01.716 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:01.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:01.718 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:01.712+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:01.820 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:01.812+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:01.863 INFO:teuthology.orchestra.run.smithi079.stdout:5247 writesame 0xe7282fc thru 0xe72db82 data_size 0x1(0x5887 bytes) 2024-09-21T14:00:01.863 INFO:teuthology.orchestra.run.smithi079.stdout:5248 write 0x845d9d6 thru 0x846a4bb (0xcae6 bytes) 2024-09-21T14:00:01.871 INFO:teuthology.orchestra.run.smithi079.stdout:5249 punch from 0x1aef181 to 0x1afecda, (0xfb59 bytes) 2024-09-21T14:00:01.871 INFO:teuthology.orchestra.run.smithi079.stdout:5250 write 0xd8a23b1 thru 0xd8b1c8d (0xf8dd bytes) 2024-09-21T14:00:01.879 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:01.879 INFO:teuthology.orchestra.run.smithi079.stdout:5252 write 0x86008fb thru 0x8609b5f (0x9265 bytes) 2024-09-21T14:00:01.881 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:01.882 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:01.882 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:01.882 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:5254 punch from 0x8de2047 to 0x8de4adf, (0x2a98 bytes) 2024-09-21T14:00:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:5255 read 0xc2e5ba thru 0xc32de5 (0x482c bytes) 2024-09-21T14:00:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:5257 read 0x8eda130 thru 0x8ee7a6a (0xd93b bytes) 2024-09-21T14:00:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:01.885 INFO:teuthology.orchestra.run.smithi079.stdout:5259 read 0xffe346 thru 0x1005b92 (0x784d bytes) 2024-09-21T14:00:01.886 INFO:teuthology.orchestra.run.smithi079.stdout:5260 writesame 0xa592001 thru 0xa5a0cc5 data_size 0x7(0xecc5 bytes) 2024-09-21T14:00:01.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:01.898 INFO:teuthology.orchestra.run.smithi079.stdout:5261 read 0x898ae4b thru 0x89922b5 (0x746b bytes) 2024-09-21T14:00:01.898 INFO:teuthology.orchestra.run.smithi079.stdout:5262 punch from 0x2e3921f to 0x2e4046b, (0x724c bytes) 2024-09-21T14:00:01.898 INFO:teuthology.orchestra.run.smithi079.stdout:5263 read 0xaa1c302 thru 0xaa1fb56 (0x3855 bytes) 2024-09-21T14:00:01.899 INFO:teuthology.orchestra.run.smithi079.stdout:5265 read 0xc0e2823 thru 0xc0e3f8d (0x176b bytes) 2024-09-21T14:00:01.899 INFO:teuthology.orchestra.run.smithi079.stdout:5266 write 0x2376c09 thru 0x237ef65 (0x835d bytes) 2024-09-21T14:00:01.901 INFO:teuthology.orchestra.run.smithi079.stdout:5267 punch from 0x5d86be0 to 0x5d965a0, (0xf9c0 bytes) 2024-09-21T14:00:01.901 INFO:teuthology.orchestra.run.smithi079.stdout:5268 read 0x42a6b3 thru 0x42c948 (0x2296 bytes) 2024-09-21T14:00:01.902 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:01.919 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:01.916+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:01.922 INFO:teuthology.orchestra.run.smithi079.stdout:5271 trunc from 0xe72db83 to 0x50661a2 2024-09-21T14:00:01.947 INFO:teuthology.orchestra.run.smithi079.stdout:5272 write 0x2fe7855 thru 0x2ff72dc (0xfa88 bytes) 2024-09-21T14:00:01.954 INFO:teuthology.orchestra.run.smithi079.stdout:5273 trunc from 0x50661a2 to 0x6b2ed7a 2024-09-21T14:00:01.965 INFO:teuthology.orchestra.run.smithi079.stdout:5274 punch from 0x3fa0564 to 0x3fa1e35, (0x18d1 bytes) 2024-09-21T14:00:01.965 INFO:teuthology.orchestra.run.smithi079.stdout:5275 writesame 0x329c5c1 thru 0x329d477 data_size 0x1(0xeb7 bytes) 2024-09-21T14:00:01.968 INFO:teuthology.orchestra.run.smithi079.stdout:5277 read 0x6738059 thru 0x6742862 (0xa80a bytes) 2024-09-21T14:00:01.969 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:01.969 INFO:teuthology.orchestra.run.smithi079.stdout:5281 punch from 0x55c615 to 0x56bef5, (0xf8e0 bytes) 2024-09-21T14:00:01.982 INFO:teuthology.orchestra.run.smithi079.stdout:5284 writesame 0x852f841 thru 0x853369b data_size 0x11(0x3e5b bytes) 2024-09-21T14:00:01.982 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:01.982 INFO:teuthology.orchestra.run.smithi079.stdout:5286 read 0x40f4b93 thru 0x40fe73e (0x9bac bytes) 2024-09-21T14:00:01.982 INFO:teuthology.orchestra.run.smithi079.stdout:5287 writesame 0x643c576 thru 0x643dd55 data_size 0x10(0x17e0 bytes) 2024-09-21T14:00:02.003 INFO:teuthology.orchestra.run.smithi079.stdout:5289 write 0xb726670 thru 0xb73266d (0xbffe bytes) 2024-09-21T14:00:02.010 INFO:teuthology.orchestra.run.smithi079.stdout:5290 writesame 0x6ae1082 thru 0x6ae81a5 data_size 0x1a(0x7124 bytes) 2024-09-21T14:00:02.017 INFO:teuthology.orchestra.run.smithi079.stdout:5291 read 0x1066dc2 thru 0x106701e (0x25d bytes) 2024-09-21T14:00:02.020 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:02.016+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:02.020 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:02.021 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:02.032 INFO:teuthology.orchestra.run.smithi079.stdout:5292 write 0xc69d638 thru 0xc6a7744 (0xa10d bytes) 2024-09-21T14:00:02.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:02.039 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.039 INFO:teuthology.orchestra.run.smithi079.stdout:5295 writesame 0xb588956 thru 0xb590000 data_size 0x1(0x76ab bytes) 2024-09-21T14:00:02.060 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.062 INFO:teuthology.orchestra.run.smithi079.stdout:5298 trunc from 0xc6a7745 to 0xb7ab4c1 2024-09-21T14:00:02.081 INFO:teuthology.orchestra.run.smithi079.stdout:5299 read 0x6534f36 thru 0x6539a7d (0x4b48 bytes) 2024-09-21T14:00:02.081 INFO:teuthology.orchestra.run.smithi079.stdout:5301 write 0x3efcac8 thru 0x3f09778 (0xccb1 bytes) 2024-09-21T14:00:02.089 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.089 INFO:teuthology.orchestra.run.smithi079.stdout:5304 punch from 0x19d1b81 to 0x19d5a77, (0x3ef6 bytes) 2024-09-21T14:00:02.099 INFO:teuthology.orchestra.run.smithi079.stdout:5305 write 0xc439fbf thru 0xc446b3a (0xcb7c bytes) 2024-09-21T14:00:02.107 INFO:teuthology.orchestra.run.smithi079.stdout:5306 read 0xa437441 thru 0xa4416fa (0xa2ba bytes) 2024-09-21T14:00:02.107 INFO:teuthology.orchestra.run.smithi079.stdout:5307 write 0xc49ff5 thru 0xc52b66 (0x8b72 bytes) 2024-09-21T14:00:02.112 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.112 INFO:teuthology.orchestra.run.smithi079.stdout:5309 write 0x365548e thru 0x365878f (0x3302 bytes) 2024-09-21T14:00:02.115 INFO:teuthology.orchestra.run.smithi079.stdout:5310 read 0x532163e thru 0x532e342 (0xcd05 bytes) 2024-09-21T14:00:02.115 INFO:teuthology.orchestra.run.smithi079.stdout:5311 writesame 0x951bb37 thru 0x952a3c3 data_size 0x1(0xe88d bytes) 2024-09-21T14:00:02.121 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:02.119+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:02.165 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:00:02.166 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:02.166 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:02.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:02.166 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:02.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.760908071000003, 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:02.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.720821232999995, 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:02.175 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.659507977000004, 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.195049039000001, 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.19500176, 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.194962258, 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:02.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:02.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.194923199, 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:02.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:02.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666559541, 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:02.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:02.200 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666531851, 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666509365, 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:02.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:02.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:02.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666462252000001, 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:02.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:02.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:02.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666441605999999, 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:02.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.216 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666417315, 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:02.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:02.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:02.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666396812, 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:02.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:02.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666374498, 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:02.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:02.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:02.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666356313, 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666337833, 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666292165, 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:02.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:02.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:02.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.666267444000001, 2024-09-21T14:00:02.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:02.249 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.66624833, 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:02.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:02.254 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:02.254 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:02.254 INFO:teuthology.orchestra.run.smithi079.stdout:5312 trunc from 0xc446b3b to 0xc056fbf 2024-09-21T14:00:02.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5313 writesame 0xd53fe2b thru 0xd548d90 data_size 0x5(0x8f66 bytes) 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5314 punch from 0x78d8713 to 0x78e5520, (0xce0d bytes) 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5315 punch from 0x94ac1e0 to 0x94ac7f4, (0x614 bytes) 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5316 read 0xb6fafdd thru 0xb7096cc (0xe6f0 bytes) 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5317 trunc from 0xd548d91 to 0x783eb43 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5318 write 0x1545d9e thru 0x15493bc (0x361f bytes) 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5319 trunc from 0x783eb43 to 0x71615c5 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5320 trunc from 0x71615c5 to 0xd31fe7f 2024-09-21T14:00:02.257 INFO:teuthology.orchestra.run.smithi079.stdout:5322 writesame 0x9efc672 thru 0x9f02448 data_size 0x1(0x5dd7 bytes) 2024-09-21T14:00:02.257 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:02.251+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:02.268 INFO:teuthology.orchestra.run.smithi079.stdout:5324 punch from 0x6ee67da to 0x6ef3dc3, (0xd5e9 bytes) 2024-09-21T14:00:02.268 INFO:teuthology.orchestra.run.smithi079.stdout:5326 writesame 0x78e0ba8 thru 0x78ea412 data_size 0x1(0x986b bytes) 2024-09-21T14:00:02.304 INFO:teuthology.orchestra.run.smithi079.stdout:5328 read 0x8d9d433 thru 0x8daa45e (0xd02c bytes) 2024-09-21T14:00:02.305 INFO:teuthology.orchestra.run.smithi079.stdout:5329 writesame 0x1d90829 thru 0x1d98e51 data_size 0x1(0x8629 bytes) 2024-09-21T14:00:02.323 INFO:teuthology.orchestra.run.smithi079.stdout:5331 write 0x7d493b6 thru 0x7d54d60 (0xb9ab bytes) 2024-09-21T14:00:02.332 INFO:teuthology.orchestra.run.smithi079.stdout:5332 read 0x44e1341 thru 0x44e142b (0xeb bytes) 2024-09-21T14:00:02.332 INFO:teuthology.orchestra.run.smithi079.stdout:5333 writesame 0x967b0da thru 0x9682c52 data_size 0x1(0x7b79 bytes) 2024-09-21T14:00:02.355 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:02.355+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:02.360 INFO:teuthology.orchestra.run.smithi079.stdout:5334 read 0x2132812 thru 0x2137a51 (0x5240 bytes) 2024-09-21T14:00:02.360 INFO:teuthology.orchestra.run.smithi079.stdout:5335 write 0x7f12e84 thru 0x7f1d2c0 (0xa43d bytes) 2024-09-21T14:00:02.368 INFO:teuthology.orchestra.run.smithi079.stdout:5336 read 0x35a341d thru 0x35ad0e7 (0x9ccb bytes) 2024-09-21T14:00:02.368 INFO:teuthology.orchestra.run.smithi079.stdout:5337 punch from 0x64611f6 to 0x646d60d, (0xc417 bytes) 2024-09-21T14:00:02.368 INFO:teuthology.orchestra.run.smithi079.stdout:5339 punch from 0x3c6500 to 0x3d19fb, (0xb4fb bytes) 2024-09-21T14:00:02.393 INFO:teuthology.orchestra.run.smithi079.stdout:5340 trunc from 0xd31fe7f to 0x2a1022f 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219415 3.11 3:8864213f:::rbd_data.1185becdc07b.0000000000000078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.402270+0000", 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0022779689999999999, 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002312461, 2024-09-21T14:00:02.405 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219415 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402270+0000", 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402270+0000", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402268+0000", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402278+0000", 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5920000000000007e-06 2024-09-21T14:00:02.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402295+0000", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7014999999999999e-05 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402306+0000", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1184e-05 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402354+0000", 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8134999999999999e-05 2024-09-21T14:00:02.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402470+0000", 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116016 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402598+0000", 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012853800000000001 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219416 3.9 3:94369a77:::rbd_data.1185becdc07b.000000000000007c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-21T14:00:02.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.402337+0000", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0022101540000000002, 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023739999999999998, 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219416 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402337+0000", 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402337+0000", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402337+0000", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402342+0000", 2024-09-21T14:00:02.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4790000000000004e-06 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402354+0000", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1618e-05 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402362+0000", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3289999999999994e-06 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402822+0000", 2024-09-21T14:00:02.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000460381 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402930+0000", 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107722 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403023+0000", 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2588000000000002e-05 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:02.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.404719+0000", 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001696496 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219417 3.f 3:f3ee6a92:::rbd_data.1185becdc07b.000000000000007d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.402370+0000", 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0021777699999999999, 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002453743, 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T14:00:02.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219417 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402370+0000", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402370+0000", 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402369+0000", 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402375+0000", 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3940000000000004e-06 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402384+0000", 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402391+0000", 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1489999999999997e-06 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402640+0000", 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024937000000000001 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402731+0000", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0569999999999995e-05 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.402854+0000", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012290399999999999 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.404341+0000", 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014873620000000001 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219422 3.9 3:955c0824:::rbd_data.1185becdc07b.000000000000009f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.403581+0000", 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00096612100000000002, 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001374063, 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219422 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403581+0000", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403581+0000", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403580+0000", 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403587+0000", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1409999999999999e-06 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403601+0000", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3616e-05 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403611+0000", 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7089999999999997e-06 2024-09-21T14:00:02.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403712+0000", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010111300000000001 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403834+0000", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121798 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.403965+0000", 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013097599999999999 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.404791+0000", 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082632199999999999 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-09-21T14:00:02.423 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:02.424 INFO:teuthology.orchestra.run.smithi079.stdout:5341 trunc from 0x2a1022f to 0x4e003be 2024-09-21T14:00:02.424 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:02.433 INFO:teuthology.orchestra.run.smithi079.stdout:5342 read 0x23384f2 thru 0x23478a1 (0xf3b0 bytes) 2024-09-21T14:00:02.434 INFO:teuthology.orchestra.run.smithi079.stdout:5343 punch from 0x34c26e1 to 0x34c61fe, (0x3b1d bytes) 2024-09-21T14:00:02.434 INFO:teuthology.orchestra.run.smithi079.stdout:5344 punch from 0x2201685 to 0x2205ae9, (0x4464 bytes) 2024-09-21T14:00:02.457 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:02.455+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:02.467 INFO:teuthology.orchestra.run.smithi079.stdout:5345 write 0xe684664 thru 0xe693b64 (0xf501 bytes) 2024-09-21T14:00:02.477 INFO:teuthology.orchestra.run.smithi079.stdout:5346 read 0x3dd68a7 thru 0x3dde4de (0x7c38 bytes) 2024-09-21T14:00:02.477 INFO:teuthology.orchestra.run.smithi079.stdout:5347 write 0xaaa1200 thru 0xaaa73b6 (0x61b7 bytes) 2024-09-21T14:00:02.483 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.483 INFO:teuthology.orchestra.run.smithi079.stdout:5350 write 0xe3793a0 thru 0xe380d47 (0x79a8 bytes) 2024-09-21T14:00:02.489 INFO:teuthology.orchestra.run.smithi079.stdout:5351 read 0x9e6f5c3 thru 0x9e78611 (0x904f bytes) 2024-09-21T14:00:02.510 INFO:teuthology.orchestra.run.smithi079.stdout:5352 trunc from 0xe693b65 to 0x6928fcb 2024-09-21T14:00:02.532 INFO:teuthology.orchestra.run.smithi079.stdout:5353 read 0x236fad1 thru 0x237c93e (0xce6e bytes) 2024-09-21T14:00:02.533 INFO:teuthology.orchestra.run.smithi079.stdout:5354 write 0x47716d8 thru 0x477955f (0x7e88 bytes) 2024-09-21T14:00:02.540 INFO:teuthology.orchestra.run.smithi079.stdout:5355 punch from 0x37fa991 to 0x37fcad4, (0x2143 bytes) 2024-09-21T14:00:02.540 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:02.540 INFO:teuthology.orchestra.run.smithi079.stdout:5359 clone 33 order 21 su 1048576 sc 10 2024-09-21T14:00:02.557 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:02.557 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:02.557 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:02.557 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:02.557 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:02.558 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:02.552+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:02.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:02.659 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:02.655+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:02.747 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.857510167000001, 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:02.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.857474937999999, 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.752 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.755 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.857449569, 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:02.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:02.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.857409026999999, 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.857368194999999, 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:02.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:02.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:02.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.748644446, 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T14:00:02.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:02.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T14:00:02.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T14:00:02.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.748620773999999, 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:02.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.143157209000002, 2024-09-21T14:00:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215671438999999, 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215656244, 2024-09-21T14:00:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215646312000001, 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215636765999999, 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215627444000001, 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.215617195, 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.214627065, 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.214596633999999, 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.214583534999999, 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.214573699000001, 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.210469985, 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.210451061000001, 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:02.834 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:02.836 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:02.836 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:02.832+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:02.936 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:02.932+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:03.013 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:03.013 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:03.013 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:03.013 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:03.028 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:03.071 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:03.068+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:03.138 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:03.132+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:03.214 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:03.214 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:03.214 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:03.214 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:03.214 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:03.228 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:03.239 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:03.235+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:03.340 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:03.339+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:03.406 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922870406000001, 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922822298, 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922760090000001, 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922711841000002, 2024-09-21T14:00:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922666493000001, 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922620040999998, 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922574262000001, 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922529204, 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922484744999998, 2024-09-21T14:00:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922432357000002, 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922399274, 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:03.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922314347, 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:03.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922267278, 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922222083000001, 2024-09-21T14:00:03.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:03.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.922164477999999, 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:03.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.920728689000001, 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:03.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.920650567999999, 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:03.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:03.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.920601315999999, 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.900502486000001, 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T14:00:03.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.610479356999999, 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:03.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:03.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:03.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:03.496 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:03.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:03.498 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:03.495+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:03.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:03.630 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:03.630 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:03.630 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:03.636 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:03.635+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:03.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:03.699 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:03.696+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:03.743 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:03.743 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:03.759 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:03.759 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:03.775 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:03.775 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:03.776 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:03.776 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:03.776 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:03.776 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:03.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:03.794 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:03.794 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:03.800 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:03.799+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:03.815 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:03.835 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:03.854 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:03.855 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:03.872 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:03.872 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:03.909 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 6, 7, 1] out_osds: [2] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:03.909 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:03.909 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-21T14:00:03.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-21T14:00:03.931 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:03.931+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:03.971 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:03.971 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:03.987 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:04.001 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:03.999+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:04.101 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:04.096+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:04.112 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.112 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:04.215 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:04.212+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:04.243 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T14:00:04.239+0000 7f74c16a6640 -1 mon.a@0(leader).osd e99 definitely_dead 0 2024-09-21T14:00:04.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:00:04.257 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-21T14:00:04.303 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:04.300+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:04.308 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.309 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:04.403 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:04.403+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:04.503 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.504 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.504 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:04.500+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:04.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:04.605 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:04.600+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:04.640 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.641 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:04.706 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:04.703+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:04.775 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.775 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:04.807 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:04.804+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:04.909 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:04.908+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:04.953 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:04.953 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:04.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:05.010 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:05.004+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:05.083 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.083 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:05.111 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:05.108+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:05.187 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.2. 2024-09-21T14:00:05.187 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:00:05.209 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-21T14:00:05.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:05.211+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:05.220 INFO:teuthology.orchestra.run.smithi079.stdout:5360 write 0x94cb42e thru 0x94d6fed (0xbbc0 bytes) 2024-09-21T14:00:05.231 INFO:teuthology.orchestra.run.smithi079.stdout:5361 trunc from 0x94d6fee to 0xd0bd9b8 2024-09-21T14:00:05.243 INFO:teuthology.orchestra.run.smithi079.stdout:5362 read 0x850e64a thru 0x851b935 (0xd2ec bytes) 2024-09-21T14:00:05.243 INFO:teuthology.orchestra.run.smithi079.stdout:5363 read 0x50d7878 thru 0x50dd7a2 (0x5f2b bytes) 2024-09-21T14:00:05.243 INFO:teuthology.orchestra.run.smithi079.stdout:5364 read 0x2fef33 thru 0x301a71 (0x2b3f bytes) 2024-09-21T14:00:05.245 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.245 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:05.313 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:05.308+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:05.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:05.411+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.419 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:05.515 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:05.508+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:05.599 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.599 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:05.615 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:05.615+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:05.717 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:05.712+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:05.738 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.738 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:05.818 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:05.812+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:05.870 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:05.871 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:05.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:05.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:05.919 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:05.916+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:06.007 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:06.008 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:06.020 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:06.019+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:06.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:06.062 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:06.063 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:06.080 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:06.080 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:06.097 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:06.097 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:06.113 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:06.114 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:06.121 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:06.119+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:06.134 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:06.134 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:06.154 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:06.174 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:06.174 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:06.179 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:06.179 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:06.179 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:06.179 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:06.180 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:5365 read 0x9359442 thru 0x936137f (0x7f3e bytes) 2024-09-21T14:00:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:5366 read 0x471c7e1 thru 0x472b4e8 (0xed08 bytes) 2024-09-21T14:00:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:5368 punch from 0x71025f7 to 0x710a6bc, (0x80c5 bytes) 2024-09-21T14:00:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:5369 read 0x76d6f6c thru 0x76d95ae (0x2643 bytes) 2024-09-21T14:00:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:5370 writesame 0xa380fce thru 0xa3830b0 data_size 0x1(0x20e3 bytes) 2024-09-21T14:00:06.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:06.199 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:06.200 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:06.213 INFO:teuthology.orchestra.run.smithi079.stdout:5371 trunc from 0xd0bd9b8 to 0xc7898c4 2024-09-21T14:00:06.234 INFO:teuthology.orchestra.run.smithi079.stdout:5372 trunc from 0xc7898c4 to 0x92c51b6 2024-09-21T14:00:06.234 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:06.231+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:06.265 INFO:teuthology.orchestra.run.smithi079.stdout:5373 read 0x593c439 thru 0x593f139 (0x2d01 bytes) 2024-09-21T14:00:06.280 INFO:teuthology.orchestra.run.smithi079.stdout:5374 write 0xb0b5802 thru 0xb0beb93 (0x9392 bytes) 2024-09-21T14:00:06.288 INFO:teuthology.orchestra.run.smithi079.stdout:5376 punch from 0xac40cbc to 0xac46a1f, (0x5d63 bytes) 2024-09-21T14:00:06.288 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.288 INFO:teuthology.orchestra.run.smithi079.stdout:5380 writesame 0xeb80be thru 0xebd806 data_size 0x29(0x5749 bytes) 2024-09-21T14:00:06.295 INFO:teuthology.orchestra.run.smithi079.stdout:5381 read 0x23dd728 thru 0x23e2c5d (0x5536 bytes) 2024-09-21T14:00:06.295 INFO:teuthology.orchestra.run.smithi079.stdout:5382 punch from 0xa592e4d to 0xa59d5fc, (0xa7af bytes) 2024-09-21T14:00:06.316 INFO:teuthology.orchestra.run.smithi079.stdout:5384 trunc from 0xb0beb94 to 0x1ed5385 2024-09-21T14:00:06.322 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:06.319+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.934042001999998, 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:06.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:06.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.343 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.893955164000005, 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.832641907999999, 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:06.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.368182969999999, 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:06.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:06.357 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.368135690999999, 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:06.361 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.368096188999999, 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.36805713, 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.366 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839693472, 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:06.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:06.373 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839665782000001, 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:06.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839643295999998, 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839596183000001, 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839575537000002, 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839551245999999, 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839530743000001, 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839508428999999, 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839490244, 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839471763999999, 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839426096, 2024-09-21T14:00:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839401375000001, 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.839382261000001, 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:06.420 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:06.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:06.421 INFO:teuthology.orchestra.run.smithi079.stdout:5385 writesame 0xe199d46 thru 0xe1a2a3d data_size 0x34(0x8cf8 bytes) 2024-09-21T14:00:06.421 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.423 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:06.420+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:5387 trunc from 0xe1a2a3e to 0x4da633f 2024-09-21T14:00:06.441 INFO:teuthology.orchestra.run.smithi079.stdout:5390 write 0x3dff85e thru 0x3e07db0 (0x8553 bytes) 2024-09-21T14:00:06.449 INFO:teuthology.orchestra.run.smithi079.stdout:5391 write 0x3dcedee thru 0x3dde591 (0xf7a4 bytes) 2024-09-21T14:00:06.455 INFO:teuthology.orchestra.run.smithi079.stdout:5392 trunc from 0x4da633f to 0x6028bf7 2024-09-21T14:00:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:5394 punch from 0x444bf02 to 0x445166a, (0x5768 bytes) 2024-09-21T14:00:06.465 INFO:teuthology.orchestra.run.smithi079.stdout:5399 read 0x1911a79 thru 0x191ecd1 (0xd259 bytes) 2024-09-21T14:00:06.492 INFO:teuthology.orchestra.run.smithi079.stdout:5400 write 0xbd61040 thru 0xbd6e00d (0xcfce bytes) 2024-09-21T14:00:06.499 INFO:teuthology.orchestra.run.smithi079.stdout:5401 read 0xa513056 thru 0xa52239d (0xf348 bytes) 2024-09-21T14:00:06.499 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.514 INFO:teuthology.orchestra.run.smithi079.stdout:5405 writesame 0xc9ba8b0 thru 0xc9c3095 data_size 0x31(0x87e6 bytes) 2024-09-21T14:00:06.523 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:06.519+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:06.530 INFO:teuthology.orchestra.run.smithi079.stdout:5406 write 0xe56191c thru 0xe567740 (0x5e25 bytes) 2024-09-21T14:00:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:5407 write 0x1669320 thru 0x1670948 (0x7629 bytes) 2024-09-21T14:00:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:5411 write 0x84b3df0 thru 0x84c172b (0xd93c bytes) 2024-09-21T14:00:06.546 INFO:teuthology.orchestra.run.smithi079.stdout:5413 write 0x7ed468f thru 0x7ed9933 (0x52a5 bytes) 2024-09-21T14:00:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:5414 read 0xda92d88 thru 0xda96c5f (0x3ed8 bytes) 2024-09-21T14:00:06.552 INFO:teuthology.orchestra.run.smithi079.stdout:5415 writesame 0x366da27 thru 0x3675330 data_size 0x1(0x790a bytes) 2024-09-21T14:00:06.560 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:06.560 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:06.561 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:06.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:5416 write 0x15958a2 thru 0x15a392d (0xe08c bytes) 2024-09-21T14:00:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:5417 read 0xe013559 thru 0xe019487 (0x5f2f bytes) 2024-09-21T14:00:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:5419 read 0xd2f5340 thru 0xd300874 (0xb535 bytes) 2024-09-21T14:00:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:06.602 INFO:teuthology.orchestra.run.smithi079.stdout:5424 write 0x81d3aa8 thru 0x81dbeb1 (0x840a bytes) 2024-09-21T14:00:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:5426 trunc from 0xe567741 to 0xd61cbdb 2024-09-21T14:00:06.624 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:06.620+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:06.639 INFO:teuthology.orchestra.run.smithi079.stdout:5428 write 0xd81daf1 thru 0xd825992 (0x7ea2 bytes) 2024-09-21T14:00:06.645 INFO:teuthology.orchestra.run.smithi079.stdout:5429 clone 34 order 20 su 131072 sc 12 2024-09-21T14:00:06.693 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:06.693 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:06.693 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:06.693 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:06.693 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:06.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:06.751 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:06.748+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:06.826 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:06.820+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:06.877 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:06.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.986485992999999, 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.878 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:06.882 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.986450764000001, 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:06.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.986425395000001, 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:06.890 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.986384853000001, 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.986344021000001, 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.877620272000001, 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.8775966, 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:06.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:06.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.272133035, 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:06.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:06.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.344647264999999, 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:06.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:06.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:06.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.344632069999999, 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:06.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:06.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:06.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.344622137999998, 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:06.922 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:06.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.344612592000001, 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.34460327, 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:06.934 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.344593021000001, 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:06.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:06.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.343602891, 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:06.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:06.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.343572460000001, 2024-09-21T14:00:06.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:06.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:06.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.343559361000001, 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.343549525, 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:06.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:06.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.339445811000001, 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.957 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:06.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:06.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.339426886999998, 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:06.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:06.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:06.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:06.965 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:06.966 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:06.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:06.967 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:06.963+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:07.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:07.067+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:07.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:07.169 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:07.167+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:07.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:00:07.270 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:07.264+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:07.275 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:07.275 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:07.275 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:07.275 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:07.275 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:07.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:07.303 INFO:teuthology.orchestra.run.smithi079.stdout:flattening image image_client.0-clone33 2024-09-21T14:00:07.370 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:07.367+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:07.451 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:07.451 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:07.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:07.451 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967318375000001, 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967270267, 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967208059000001, 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:07.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967159809999998, 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967114462000001, 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:07.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967068009999998, 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:07.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:07.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.967022231000001, 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:07.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966977173, 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:07.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966932713999999, 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:07.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:07.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966880325999998, 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966847243, 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:07.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:07.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966762316000001, 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.500 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:07.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:07.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966715247, 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:07.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966670052000001, 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:07.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.966612446999999, 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:07.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.965176658000001, 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:07.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.965098536999999, 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:07.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.965049284999999, 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:07.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:07.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:07.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.944950455000001, 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:07.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T14:00:07.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.654927325999999, 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:07.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:07.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:07.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:07.541 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:07.542 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-21T14:00:07.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:07.543 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:07.539+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:07.643 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:07.640+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:07.673 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:07.673 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:07.687 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:07.708 INFO:teuthology.orchestra.run.smithi079.stdout:5430 writesame 0xbada8e thru 0xbb32a2 data_size 0x1(0x5815 bytes) 2024-09-21T14:00:07.738 INFO:teuthology.orchestra.run.smithi079.stdout:5431 punch from 0x5d0c9e6 to 0x5d169fc, (0xa016 bytes) 2024-09-21T14:00:07.738 INFO:teuthology.orchestra.run.smithi079.stdout:5432 punch from 0x9c82f18 to 0x9c894df, (0x65c7 bytes) 2024-09-21T14:00:07.738 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:07.738 INFO:teuthology.orchestra.run.smithi079.stdout:5435 writesame 0xcf8547a thru 0xcf917c0 data_size 0x1(0xc347 bytes) 2024-09-21T14:00:07.744 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:07.743+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:07.809 INFO:teuthology.orchestra.run.smithi079.stdout:5436 write 0x7221b26 thru 0x7226fc7 (0x54a2 bytes) 2024-09-21T14:00:07.817 INFO:teuthology.orchestra.run.smithi079.stdout:5437 writesame 0x7e9ce3e thru 0x7eab5ae data_size 0x1(0xe771 bytes) 2024-09-21T14:00:07.845 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:07.843+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:07.857 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:07.857 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:07.857 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:07.857 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:07.857 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:07.871 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:07.887 INFO:teuthology.orchestra.run.smithi079.stdout:5439 write 0x1351956 thru 0x1359fb4 (0x865f bytes) 2024-09-21T14:00:07.896 INFO:teuthology.orchestra.run.smithi079.stdout:5440 writesame 0x51941d thru 0x51bea7 data_size 0x1(0x2a8b bytes) 2024-09-21T14:00:07.915 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:07.915 INFO:teuthology.orchestra.run.smithi079.stdout:5442 read 0xb2f9c9 thru 0xb3c560 (0xcb98 bytes) 2024-09-21T14:00:07.916 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:07.916 INFO:teuthology.orchestra.run.smithi079.stdout:5445 write 0xb91f527 thru 0xb92b530 (0xc00a bytes) 2024-09-21T14:00:07.927 INFO:teuthology.orchestra.run.smithi079.stdout:5446 write 0xc518da thru 0xc5ab7d (0x92a4 bytes) 2024-09-21T14:00:07.935 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:07.935 INFO:teuthology.orchestra.run.smithi079.stdout:5451 writesame 0x4ba2a8 thru 0x4c04f5 data_size 0x1(0x624e bytes) 2024-09-21T14:00:07.946 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:07.940+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:07.973 INFO:teuthology.orchestra.run.smithi079.stdout:5452 read 0x5fb62e1 thru 0x5fbce89 (0x6ba9 bytes) 2024-09-21T14:00:07.999 INFO:teuthology.orchestra.run.smithi079.stdout:5454 trunc from 0xd825993 to 0x38d7211 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.123926826000002, 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:08.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.116049662999998, 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:08.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:08.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112112640999996, 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:08.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112101432000003, 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:08.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112090260000002, 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112075957000002, 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112040496999995, 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:08.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112027334000004, 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.112015803000006, 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.108027835000001, 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:08.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.108008202999997, 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:08.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:08.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107983375000003, 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:08.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107958378000006, 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107946307999995, 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107934987999997, 2024-09-21T14:00:08.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:08.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107923846999995, 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:08.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:08.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:08.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107911545999997, 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:08.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:08.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:08.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 81.107900294000004, 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.085 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:08.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:08.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 79.031830541999994, 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:08.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 79.022603966000005, 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:08.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:08.101 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:08.103 INFO:teuthology.orchestra.run.smithi079.stdout:5455 read 0x10959e8 thru 0x109757c (0x1b95 bytes) 2024-09-21T14:00:08.104 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.104 INFO:teuthology.orchestra.run.smithi079.stdout:5458 writesame 0xc3fed79 thru 0xc403acc data_size 0x31(0x4d54 bytes) 2024-09-21T14:00:08.104 INFO:teuthology.orchestra.run.smithi079.stdout:5459 read 0x950e454 thru 0x9519b8e (0xb73b bytes) 2024-09-21T14:00:08.104 INFO:teuthology.orchestra.run.smithi079.stdout:5460 write 0xb5794e9 thru 0xb57e37e (0x4e96 bytes) 2024-09-21T14:00:08.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:08.105 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:08.100+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:08.119 INFO:teuthology.orchestra.run.smithi079.stdout:5461 trunc from 0xc403acd to 0x64dd9c4 2024-09-21T14:00:08.147 INFO:teuthology.orchestra.run.smithi079.stdout:5462 punch from 0x53bff26 to 0x53cf8c4, (0xf99e bytes) 2024-09-21T14:00:08.147 INFO:teuthology.orchestra.run.smithi079.stdout:5463 read 0x29594d6 thru 0x2961288 (0x7db3 bytes) 2024-09-21T14:00:08.147 INFO:teuthology.orchestra.run.smithi079.stdout:5464 write 0x10db3b4 thru 0x10e3fde (0x8c2b bytes) 2024-09-21T14:00:08.188 INFO:teuthology.orchestra.run.smithi079.stdout:5465 write 0xce4ddc8 thru 0xce5d201 (0xf43a bytes) 2024-09-21T14:00:08.197 INFO:teuthology.orchestra.run.smithi079.stdout:5466 trunc from 0xce5d202 to 0xd38b4f4 2024-09-21T14:00:08.204 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:08.200+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:08.207 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:00:08.216 INFO:teuthology.orchestra.run.smithi079.stdout:5467 write 0xd0316a0 thru 0xd03e680 (0xcfe1 bytes) 2024-09-21T14:00:08.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:08.240 INFO:teuthology.orchestra.run.smithi079.stdout:5468 trunc from 0xd38b4f4 to 0x420412d 2024-09-21T14:00:08.267 INFO:teuthology.orchestra.run.smithi079.stdout:5471 trunc from 0x420412d to 0x966577b 2024-09-21T14:00:08.285 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:08.285 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:08.286 INFO:teuthology.orchestra.run.smithi079.stdout:5472 trunc from 0x966577b to 0x275559c 2024-09-21T14:00:08.303 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:08.333 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.333 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.347 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:08.344+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:08.352 INFO:teuthology.orchestra.run.smithi079.stdout:5477 write 0x9cf746b thru 0x9cfcd7f (0x5915 bytes) 2024-09-21T14:00:08.359 INFO:teuthology.orchestra.run.smithi079.stdout:5478 write 0x567203e thru 0x567d5ff (0xb5c2 bytes) 2024-09-21T14:00:08.363 INFO:teuthology.orchestra.run.smithi079.stdout:5479 read 0x1317558 thru 0x131941b (0x1ec4 bytes) 2024-09-21T14:00:08.375 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:08.378 INFO:teuthology.orchestra.run.smithi079.stdout:5480 writesame 0xe7cf25c thru 0xe7de631 data_size 0x17(0xf3d6 bytes) 2024-09-21T14:00:08.378 INFO:teuthology.orchestra.run.smithi079.stdout:5481 read 0xbad2779 thru 0xbae144f (0xecd7 bytes) 2024-09-21T14:00:08.378 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.378 INFO:teuthology.orchestra.run.smithi079.stdout:5483 punch from 0x9a0948f to 0x9a1806e, (0xebdf bytes) 2024-09-21T14:00:08.378 INFO:teuthology.orchestra.run.smithi079.stdout:5484 write 0xa87c86d thru 0xa8895bd (0xcd51 bytes) 2024-09-21T14:00:08.387 INFO:teuthology.orchestra.run.smithi079.stdout:5485 write 0x8466515 thru 0x84745fa (0xe0e6 bytes) 2024-09-21T14:00:08.391 INFO:teuthology.orchestra.run.smithi079.stdout:5486 write 0x7a529a1 thru 0x7a5ec99 (0xc2f9 bytes) 2024-09-21T14:00:08.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:08.393 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:08.398 INFO:teuthology.orchestra.run.smithi079.stdout:5487 punch from 0xd27ae80 to 0xd280b3a, (0x5cba bytes) 2024-09-21T14:00:08.398 INFO:teuthology.orchestra.run.smithi079.stdout:5488 read 0xa6f727a thru 0xa7037ee (0xc575 bytes) 2024-09-21T14:00:08.398 INFO:teuthology.orchestra.run.smithi079.stdout:5489 read 0xa185c64 thru 0xa18a296 (0x4633 bytes) 2024-09-21T14:00:08.399 INFO:teuthology.orchestra.run.smithi079.stdout:5490 trunc from 0xe7de632 to 0xdece96a 2024-09-21T14:00:08.405 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:08.400+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:08.406 INFO:teuthology.orchestra.run.smithi079.stdout:5492 write 0xc5b36aa thru 0xc5b8c1e (0x5575 bytes) 2024-09-21T14:00:08.410 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:08.411 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:08.411 INFO:teuthology.orchestra.run.smithi079.stdout:5500 read 0x94c008e thru 0x94cfccb (0xfc3e bytes) 2024-09-21T14:00:08.412 INFO:teuthology.orchestra.run.smithi079.stdout:5502 write 0x927efe7 thru 0x9287e8d (0x8ea7 bytes) 2024-09-21T14:00:08.429 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:08.429 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:08.435 INFO:teuthology.orchestra.run.smithi079.stdout:5503 trunc from 0xdece96a to 0x296af8b 2024-09-21T14:00:08.452 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:08.452 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:08.459 INFO:teuthology.orchestra.run.smithi079.stdout:5504 punch from 0x231e038 to 0x23297e8, (0xb7b0 bytes) 2024-09-21T14:00:08.459 INFO:teuthology.orchestra.run.smithi079.stdout:5505 read 0x3bf8ef thru 0x3cb42a (0xbb3c bytes) 2024-09-21T14:00:08.472 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:08.472 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:08.472 INFO:teuthology.orchestra.run.smithi079.stdout:5506 write 0x666688e thru 0x66743d0 (0xdb43 bytes) 2024-09-21T14:00:08.475 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:08.475 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:08.475 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:08.475 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:08.475 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:08.481 INFO:teuthology.orchestra.run.smithi079.stdout:5507 trunc from 0x66743d1 to 0x41806ee 2024-09-21T14:00:08.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:08.490 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:08.491 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:08.500 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.500 INFO:teuthology.orchestra.run.smithi079.stdout:5509 read 0xaaf556 thru 0xab3099 (0x3b44 bytes) 2024-09-21T14:00:08.501 INFO:teuthology.orchestra.run.smithi079.stdout:5510 read 0x3db18f1 thru 0x3dbe512 (0xcc22 bytes) 2024-09-21T14:00:08.505 INFO:teuthology.orchestra.run.smithi079.stdout:5511 trunc from 0x41806ee to 0x6c82f34 2024-09-21T14:00:08.511 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:08.511 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:08.512 INFO:teuthology.orchestra.run.smithi079.stdout:5513 read 0x123428b thru 0x123b44b (0x71c1 bytes) 2024-09-21T14:00:08.513 INFO:teuthology.orchestra.run.smithi079.stdout:5514 write 0x2855772 thru 0x285b7ed (0x607c bytes) 2024-09-21T14:00:08.515 INFO:teuthology.orchestra.run.smithi079.stdout:5515 writesame 0x335b980 thru 0x335d2e6 data_size 0x1(0x1967 bytes) 2024-09-21T14:00:08.527 INFO:teuthology.orchestra.run.smithi079.stdout:5516 trunc from 0x6c82f34 to 0x7f37176 2024-09-21T14:00:08.531 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:08.528+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:08.533 INFO:teuthology.orchestra.run.smithi079.stdout:5517 read 0x15970f thru 0x164127 (0xaa19 bytes) 2024-09-21T14:00:08.535 INFO:teuthology.orchestra.run.smithi079.stdout:5518 read 0x1e18bd6 thru 0x1e263ac (0xd7d7 bytes) 2024-09-21T14:00:08.535 INFO:teuthology.orchestra.run.smithi079.stdout:5519 write 0xe1dbcb thru 0xe2c47c (0xe8b2 bytes) 2024-09-21T14:00:08.552 INFO:teuthology.orchestra.run.smithi079.stdout:5521 write 0x956af95 thru 0x957453e (0x95aa bytes) 2024-09-21T14:00:08.557 INFO:teuthology.orchestra.run.smithi079.stdout:5522 read 0x6cf8442 thru 0x6cff466 (0x7025 bytes) 2024-09-21T14:00:08.557 INFO:teuthology.orchestra.run.smithi079.stdout:5523 writesame 0x101bd3c thru 0x1021f11 data_size 0x7(0x61d6 bytes) 2024-09-21T14:00:08.565 INFO:teuthology.orchestra.run.smithi079.stdout:5524 read 0x1be724e thru 0x1bf19ee (0xa7a1 bytes) 2024-09-21T14:00:08.565 INFO:teuthology.orchestra.run.smithi079.stdout:5526 writesame 0x6b87de8 thru 0x6b87fcc data_size 0x1(0x1e5 bytes) 2024-09-21T14:00:08.569 INFO:teuthology.orchestra.run.smithi079.stdout:5527 read 0x924adfa thru 0x924af9e (0x1a5 bytes) 2024-09-21T14:00:08.569 INFO:teuthology.orchestra.run.smithi079.stdout:5528 write 0xd7126e thru 0xd7cebb (0xbc4e bytes) 2024-09-21T14:00:08.575 INFO:teuthology.orchestra.run.smithi079.stdout:5529 trunc from 0x957453f to 0x9a44290 2024-09-21T14:00:08.582 INFO:teuthology.orchestra.run.smithi079.stdout:5530 write 0x805c0f6 thru 0x806b012 (0xef1d bytes) 2024-09-21T14:00:08.595 INFO:teuthology.orchestra.run.smithi079.stdout:5531 trunc from 0x9a44290 to 0xc7b9347 2024-09-21T14:00:08.603 INFO:teuthology.orchestra.run.smithi079.stdout:5532 punch from 0x586c028 to 0x5875dd2, (0x9daa bytes) 2024-09-21T14:00:08.607 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:08.603+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:08.617 INFO:teuthology.orchestra.run.smithi079.stdout:5533 trunc from 0xc7b9347 to 0x45fed95 2024-09-21T14:00:08.638 INFO:teuthology.orchestra.run.smithi079.stdout:5535 trunc from 0x45fed95 to 0x4b07244 2024-09-21T14:00:08.665 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:08.665 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:08.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:08.683 INFO:teuthology.orchestra.run.smithi079.stdout:5536 write 0xe6e61df thru 0xe6efb23 (0x9945 bytes) 2024-09-21T14:00:08.690 INFO:teuthology.orchestra.run.smithi079.stdout:5537 read 0x232f06 thru 0x23c8a2 (0x999d bytes) 2024-09-21T14:00:08.691 INFO:teuthology.orchestra.run.smithi079.stdout:5538 write 0xb152b6b thru 0xb15e548 (0xb9de bytes) 2024-09-21T14:00:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:5541 read 0x724f1bc thru 0x7252b72 (0x39b7 bytes) 2024-09-21T14:00:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.697 INFO:teuthology.orchestra.run.smithi079.stdout:5546 writesame 0x960b47a thru 0x960e05e data_size 0x1(0x2be5 bytes) 2024-09-21T14:00:08.707 INFO:teuthology.orchestra.run.smithi079.stdout:5548 read 0xb2e20e9 thru 0xb2f07e3 (0xe6fb bytes) 2024-09-21T14:00:08.707 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:08.704+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:08.722 INFO:teuthology.orchestra.run.smithi079.stdout:5549 trunc from 0xe6efb24 to 0x6b8da44 2024-09-21T14:00:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:5550 read 0xc7e719 thru 0xc804e8 (0x1dd0 bytes) 2024-09-21T14:00:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.742 INFO:teuthology.orchestra.run.smithi079.stdout:5552 trunc from 0x6b8da44 to 0x555b20c 2024-09-21T14:00:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:5553 punch from 0x1da72c7 to 0x1db235e, (0xb097 bytes) 2024-09-21T14:00:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:5554 read 0x3f82e50 thru 0x3f88a58 (0x5c09 bytes) 2024-09-21T14:00:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:5556 write 0x3df3f48 thru 0x3df67ad (0x2866 bytes) 2024-09-21T14:00:08.758 INFO:teuthology.orchestra.run.smithi079.stdout:5557 read 0x1e90b4 thru 0x1f469b (0xb5e8 bytes) 2024-09-21T14:00:08.760 INFO:teuthology.orchestra.run.smithi079.stdout:5558 write 0x25cdf63 thru 0x25d6f7c (0x901a bytes) 2024-09-21T14:00:08.771 INFO:teuthology.orchestra.run.smithi079.stdout:5560 trunc from 0x555b20c to 0x9498469 2024-09-21T14:00:08.782 INFO:teuthology.orchestra.run.smithi079.stdout:5561 read 0x776382f thru 0x7771a8d (0xe25f bytes) 2024-09-21T14:00:08.782 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.782 INFO:teuthology.orchestra.run.smithi079.stdout:5563 read 0x66b038f thru 0x66b2d18 (0x298a bytes) 2024-09-21T14:00:08.782 INFO:teuthology.orchestra.run.smithi079.stdout:5564 write 0x21e26e1 thru 0x21e761d (0x4f3d bytes) 2024-09-21T14:00:08.790 INFO:teuthology.orchestra.run.smithi079.stdout:5565 write 0x5cc8893 thru 0x5cca10b (0x1879 bytes) 2024-09-21T14:00:08.796 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:5567 punch from 0x831cafa to 0x83290af, (0xc5b5 bytes) 2024-09-21T14:00:08.808 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:08.807+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:08.809 INFO:teuthology.orchestra.run.smithi079.stdout:5568 write 0xac7a7dc thru 0xac8a393 (0xfbb8 bytes) 2024-09-21T14:00:08.819 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:08.820 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:08.821 INFO:teuthology.orchestra.run.smithi079.stdout:5569 write 0x3d49be thru 0x3e200f (0xd652 bytes) 2024-09-21T14:00:08.833 INFO:teuthology.orchestra.run.smithi079.stdout:5571 writesame 0x5c0995 thru 0x5cb8e5 data_size 0x1(0xaf51 bytes) 2024-09-21T14:00:08.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:08.901 INFO:teuthology.orchestra.run.smithi079.stdout:5572 read 0x36bf5e1 thru 0x36c4f01 (0x5921 bytes) 2024-09-21T14:00:08.909 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:08.904+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:08.917 INFO:teuthology.orchestra.run.smithi079.stdout:5573 write 0xcdf25a4 thru 0xcdf71d7 (0x4c34 bytes) 2024-09-21T14:00:08.924 INFO:teuthology.orchestra.run.smithi079.stdout:5575 write 0x352ccbf thru 0x352f0b1 (0x23f3 bytes) 2024-09-21T14:00:08.933 INFO:teuthology.orchestra.run.smithi079.stdout:5576 trunc from 0xcdf71d8 to 0xbcfc026 2024-09-21T14:00:08.954 INFO:teuthology.orchestra.run.smithi079.stdout:5577 read 0x59bc1e thru 0x59cb9f (0xf82 bytes) 2024-09-21T14:00:08.955 INFO:teuthology.orchestra.run.smithi079.stdout:5578 writesame 0x87a5b3d thru 0x87b3a58 data_size 0x83(0xdf1c bytes) 2024-09-21T14:00:08.963 INFO:teuthology.orchestra.run.smithi079.stdout:5579 punch from 0x36c9a93 to 0x36d2626, (0x8b93 bytes) 2024-09-21T14:00:08.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.963 INFO:teuthology.orchestra.run.smithi079.stdout:5583 punch from 0xb9b5157 to 0xb9badbd, (0x5c66 bytes) 2024-09-21T14:00:08.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.963 INFO:teuthology.orchestra.run.smithi079.stdout:5585 write 0x7fec4df thru 0x7ff76ae (0xb1d0 bytes) 2024-09-21T14:00:08.971 INFO:teuthology.orchestra.run.smithi079.stdout:5587 read 0x265c41 thru 0x26fdf2 (0xa1b2 bytes) 2024-09-21T14:00:08.972 INFO:teuthology.orchestra.run.smithi079.stdout:5588 punch from 0x73ab9c3 to 0x73b2df5, (0x7432 bytes) 2024-09-21T14:00:08.972 INFO:teuthology.orchestra.run.smithi079.stdout:5591 read 0x24baf62 thru 0x24bc74f (0x17ee bytes) 2024-09-21T14:00:08.973 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:08.973 INFO:teuthology.orchestra.run.smithi079.stdout:5594 writesame 0x404028c thru 0x40433f5 data_size 0x37(0x316a bytes) 2024-09-21T14:00:08.981 INFO:teuthology.orchestra.run.smithi079.stdout:5595 write 0x4371b17 thru 0x437ff3e (0xe428 bytes) 2024-09-21T14:00:08.988 INFO:teuthology.orchestra.run.smithi079.stdout:5596 trunc from 0xbcfc026 to 0xbe06f3e 2024-09-21T14:00:09.000 INFO:teuthology.orchestra.run.smithi079.stdout:5598 trunc from 0xbe06f3e to 0xab9cec6 2024-09-21T14:00:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.003 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.010 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:09.007+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:09.014 INFO:teuthology.orchestra.run.smithi079.stdout:5599 write 0x99cd67b thru 0x99d6426 (0x8dac bytes) 2024-09-21T14:00:09.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:09.022 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.022 INFO:teuthology.orchestra.run.smithi079.stdout:5601 write 0x6c4957b thru 0x6c56ae0 (0xd566 bytes) 2024-09-21T14:00:09.043 INFO:teuthology.orchestra.run.smithi079.stdout:5602 write 0xe79c618 thru 0xe7a44fe (0x7ee7 bytes) 2024-09-21T14:00:09.053 INFO:teuthology.orchestra.run.smithi079.stdout:5604 read 0x8d1ecc5 thru 0x8d2a405 (0xb741 bytes) 2024-09-21T14:00:09.053 INFO:teuthology.orchestra.run.smithi079.stdout:5605 write 0x65c78e9 thru 0x65ca952 (0x306a bytes) 2024-09-21T14:00:09.061 INFO:teuthology.orchestra.run.smithi079.stdout:5607 write 0x715958e thru 0x7161f80 (0x89f3 bytes) 2024-09-21T14:00:09.077 INFO:teuthology.orchestra.run.smithi079.stdout:5609 trunc from 0xe7a44ff to 0xb65002e 2024-09-21T14:00:09.111 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:09.107+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:09.122 INFO:teuthology.orchestra.run.smithi079.stdout:5613 trunc from 0xb65002e to 0x10f730f 2024-09-21T14:00:09.166 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.166 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:09.201 INFO:teuthology.orchestra.run.smithi079.stdout:5614 write 0x8d5e9de thru 0x8d62cfa (0x431d bytes) 2024-09-21T14:00:09.211 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.211 INFO:teuthology.orchestra.run.smithi079.stdout:5618 punch from 0x47f66eb to 0x47fe732, (0x8047 bytes) 2024-09-21T14:00:09.212 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:09.208+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:09.221 INFO:teuthology.orchestra.run.smithi079.stdout:5619 writesame 0x92d98e7 thru 0x92e7fe6 data_size 0xe0(0xe700 bytes) 2024-09-21T14:00:09.221 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.234 INFO:teuthology.orchestra.run.smithi079.stdout:5621 write 0xbfc663a thru 0xbfce4f3 (0x7eba bytes) 2024-09-21T14:00:09.241 INFO:teuthology.orchestra.run.smithi079.stdout:5622 write 0x6239e3d thru 0x624680e (0xc9d2 bytes) 2024-09-21T14:00:09.257 INFO:teuthology.orchestra.run.smithi079.stdout:5623 write 0xc1984f0 thru 0xc1a56a3 (0xd1b4 bytes) 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:5624 read 0x6adc8f9 thru 0x6aea243 (0xd94b bytes) 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:5627 read 0x98dcc07 thru 0x98e65d7 (0x99d1 bytes) 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:5628 punch from 0x142414e to 0x142f1f6, (0xb0a8 bytes) 2024-09-21T14:00:09.267 INFO:teuthology.orchestra.run.smithi079.stdout:5629 write 0x417ff5c thru 0x41823a2 (0x2447 bytes) 2024-09-21T14:00:09.277 INFO:teuthology.orchestra.run.smithi079.stdout:5631 read 0x9adf4f5 thru 0x9ae90df (0x9beb bytes) 2024-09-21T14:00:09.277 INFO:teuthology.orchestra.run.smithi079.stdout:5633 write 0x6ea0de6 thru 0x6eabdd3 (0xafee bytes) 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:5638 punch from 0x6b60815 to 0x6b63055, (0x2840 bytes) 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:5639 read 0x20f9991 thru 0x2107385 (0xd9f5 bytes) 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:5640 read 0x7b6d89f thru 0x7b7b2d7 (0xda39 bytes) 2024-09-21T14:00:09.284 INFO:teuthology.orchestra.run.smithi079.stdout:5641 writesame 0x9d128d0 thru 0x9d21435 data_size 0x1d(0xeb66 bytes) 2024-09-21T14:00:09.294 INFO:teuthology.orchestra.run.smithi079.stdout:5642 write 0x40fbfca thru 0x410a473 (0xe4aa bytes) 2024-09-21T14:00:09.303 INFO:teuthology.orchestra.run.smithi079.stdout:5643 write 0x4eb64cc thru 0x4ebf7be (0x92f3 bytes) 2024-09-21T14:00:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:5644 punch from 0x266df44 to 0x2676ba4, (0x8c60 bytes) 2024-09-21T14:00:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:5645 punch from 0xad26c87 to 0xad2fadf, (0x8e58 bytes) 2024-09-21T14:00:09.311 INFO:teuthology.orchestra.run.smithi079.stdout:5648 writesame 0x91b4c60 thru 0x91b6f8d data_size 0x39(0x232e bytes) 2024-09-21T14:00:09.312 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:09.311+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:09.317 INFO:teuthology.orchestra.run.smithi079.stdout:5649 write 0xbb4c51 thru 0xbb8ff8 (0x43a8 bytes) 2024-09-21T14:00:09.325 INFO:teuthology.orchestra.run.smithi079.stdout:5651 trunc from 0xc1a56a4 to 0x8dce4d7 2024-09-21T14:00:09.329 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.330 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:09.370 INFO:teuthology.orchestra.run.smithi079.stdout:5652 write 0xd2ad111 thru 0xd2b5d34 (0x8c24 bytes) 2024-09-21T14:00:09.378 INFO:teuthology.orchestra.run.smithi079.stdout:5653 write 0xa23d36f thru 0xa2441a0 (0x6e32 bytes) 2024-09-21T14:00:09.397 INFO:teuthology.orchestra.run.smithi079.stdout:5654 write 0xdfe7daf thru 0xdff53b3 (0xd605 bytes) 2024-09-21T14:00:09.404 INFO:teuthology.orchestra.run.smithi079.stdout:5656 read 0x7232252 thru 0x72360d1 (0x3e80 bytes) 2024-09-21T14:00:09.404 INFO:teuthology.orchestra.run.smithi079.stdout:5657 write 0xbb89df thru 0xbba2ee (0x1910 bytes) 2024-09-21T14:00:09.407 INFO:teuthology.orchestra.run.smithi079.stdout:5658 clone 35 order 21 su 32768 sc 10 2024-09-21T14:00:09.413 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:09.408+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:09.505 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.506 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.514 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:09.508+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:09.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:09.615 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:09.612+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:09.683 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.683 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:09.744 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:09.743+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:09.813 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.813 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:09.817 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:09.815+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:09.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:09.918 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:09.912+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:09.992 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:09.992 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:10.052 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:10.051+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:10.119 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:10.116+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:10.123 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:10.124 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:10.210 INFO:tasks.thrashosds.thrasher:in_osds: [0, 3, 4, 5, 6, 7, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:10.210 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:10.210 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 3, 4, 5, 6, 7, 1, 2] 2024-09-21T14:00:10.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-21T14:00:10.224 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:10.223+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:10.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T14:00:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.320 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:10.316+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:10.326 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone34 intact 2024-09-21T14:00:10.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:10.421 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:10.416+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:10.453 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:10.453 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:10.522 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:10.519+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:10.527 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-21T14:00:10.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:10.593 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T14:00:10.591+0000 7f74c16a6640 -1 mon.a@0(leader).osd e104 definitely_dead 0 2024-09-21T14:00:10.595 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:10.595 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.612 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:10.623 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:10.623+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:10.683 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:10.683 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:10.713 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:10.725 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:10.720+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:10.729 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:10.729 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:10.746 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:10.746 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:10.757 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:10.758 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:10.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:10.775 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:10.776 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:10.792 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:10.792 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:10.811 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:10.811 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:10.826 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:10.823+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:10.830 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:10.830 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:10.924 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:10.924 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:10.926 INFO:teuthology.orchestra.run.smithi079.stdout:5659 read 0x61bbee4 thru 0x61c0d34 (0x4e51 bytes) 2024-09-21T14:00:10.926 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:10.923+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:10.928 INFO:teuthology.orchestra.run.smithi079.stdout:5660 trunc from 0xdff53b4 to 0xe87dc51 2024-09-21T14:00:10.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:10.942 INFO:teuthology.orchestra.run.smithi079.stdout:5661 punch from 0x87fa434 to 0x8804232, (0x9dfe bytes) 2024-09-21T14:00:10.942 INFO:teuthology.orchestra.run.smithi079.stdout:5662 write 0x4c93556 thru 0x4c9f0ce (0xbb79 bytes) 2024-09-21T14:00:10.950 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:10.950 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:10.950 INFO:teuthology.orchestra.run.smithi079.stdout:5666 write 0xac61a10 thru 0xac6bfcf (0xa5c0 bytes) 2024-09-21T14:00:10.954 INFO:teuthology.orchestra.run.smithi079.stdout:5667 write 0x200ae8e thru 0x2015885 (0xa9f8 bytes) 2024-09-21T14:00:10.960 INFO:teuthology.orchestra.run.smithi079.stdout:5668 write 0x56367b6 thru 0x564230b (0xbb56 bytes) 2024-09-21T14:00:10.968 INFO:teuthology.orchestra.run.smithi079.stdout:5670 write 0x7f2eb3b thru 0x7f3c1d5 (0xd69b bytes) 2024-09-21T14:00:10.975 INFO:teuthology.orchestra.run.smithi079.stdout:5671 writesame 0x361d3a4 thru 0x3625e2f data_size 0x2(0x8a8c bytes) 2024-09-21T14:00:10.987 INFO:teuthology.orchestra.run.smithi079.stdout:5673 write 0x6e65e15 thru 0x6e6856c (0x2758 bytes) 2024-09-21T14:00:10.994 INFO:teuthology.orchestra.run.smithi079.stdout:5674 write 0xa6f3fa1 thru 0xa701595 (0xd5f5 bytes) 2024-09-21T14:00:11.003 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:11.003 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:11.003 INFO:teuthology.orchestra.run.smithi079.stdout:5677 read 0xd669db7 thru 0xd672010 (0x825a bytes) 2024-09-21T14:00:11.003 INFO:teuthology.orchestra.run.smithi079.stdout:5678 writesame 0xd30e506 thru 0xd31ba08 data_size 0x53(0xd503 bytes) 2024-09-21T14:00:11.010 INFO:teuthology.orchestra.run.smithi079.stdout:5679 write 0x9a84e65 thru 0x9a91deb (0xcf87 bytes) 2024-09-21T14:00:11.019 INFO:teuthology.orchestra.run.smithi079.stdout:5680 write 0x89d8ba thru 0x8abc0a (0xe351 bytes) 2024-09-21T14:00:11.027 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:11.023+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:11.044 INFO:teuthology.orchestra.run.smithi079.stdout:5683 punch from 0xd72570c to 0xd72f7b3, (0xa0a7 bytes) 2024-09-21T14:00:11.044 INFO:teuthology.orchestra.run.smithi079.stdout:5684 writesame 0xb9d28ae thru 0xb9d8dcf data_size 0xf(0x6522 bytes) 2024-09-21T14:00:11.051 INFO:teuthology.orchestra.run.smithi079.stdout:5686 read 0xcfc8dd5 thru 0xcfd2858 (0x9a84 bytes) 2024-09-21T14:00:11.051 INFO:teuthology.orchestra.run.smithi079.stdout:5687 punch from 0x4b1659 to 0x4b5349, (0x3cf0 bytes) 2024-09-21T14:00:11.058 INFO:teuthology.orchestra.run.smithi079.stdout:5688 trunc from 0xe87dc51 to 0xa811254 2024-09-21T14:00:11.083 INFO:teuthology.orchestra.run.smithi079.stdout:5689 writesame 0x121c053 thru 0x1220fec data_size 0x17(0x4f9a bytes) 2024-09-21T14:00:11.084 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:11.084 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.194775012000001, 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.085 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:11.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:11.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.194739783000003, 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:11.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:11.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.194714414000003, 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:11.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:11.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.194673872000003, 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:11.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.194633039999999, 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:11.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:11.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184628 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7618560~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.085909291, 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090421723999999995, 2024-09-21T14:00:11.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184628 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997764+0000", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997767+0000", 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0639999999999998e-06 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997776+0000", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.602e-06 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997782+0000", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6830000000000002e-06 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088050+0000", 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090268156000000002 2024-09-21T14:00:11.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088110+0000", 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9574000000000003e-05 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088186+0000", 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6252000000000001e-05 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.085885619000003, 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:11.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:11.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.480422054000002, 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:11.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.552936284000001, 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:11.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.552921089000002, 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:11.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.129 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.552911157, 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.133 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.552901610999999, 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:11.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.552892288999999, 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:11.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:11.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.55288204, 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:11.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.551891909999998, 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:11.147 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.551861478999999, 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.551848379999999, 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:11.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.551838543999999, 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:11.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.54773483, 2024-09-21T14:00:11.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:11.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.547715906000001, 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:11.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:11.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.174 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:11.175 INFO:teuthology.orchestra.run.smithi079.stdout:5691 read 0x110396c thru 0x1107c72 (0x4307 bytes) 2024-09-21T14:00:11.176 INFO:teuthology.orchestra.run.smithi079.stdout:5693 read 0x71f387 thru 0x72b07a (0xbcf4 bytes) 2024-09-21T14:00:11.176 INFO:teuthology.orchestra.run.smithi079.stdout:5694 trunc from 0xa811254 to 0x27afbc7 2024-09-21T14:00:11.176 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:11.175+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:11.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:11.192 INFO:teuthology.orchestra.run.smithi079.stdout:5695 writesame 0x4cc66c1 thru 0x4cd1141 data_size 0x1(0xaa81 bytes) 2024-09-21T14:00:11.223 INFO:teuthology.orchestra.run.smithi079.stdout:5697 write 0xc519e4b thru 0xc51c7cb (0x2981 bytes) 2024-09-21T14:00:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.0. 2024-09-21T14:00:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T14:00:11.237 INFO:teuthology.orchestra.run.smithi079.stdout:5698 read 0x43b8550 thru 0x43bab02 (0x25b3 bytes) 2024-09-21T14:00:11.303 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:11.304 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:11.304 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:11.304 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:11.308 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:11.307+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:11.318 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:11.377 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:11.375+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:11.438 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:11.439 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:11.439 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:11.439 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:11.439 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:11.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:11.499 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:11.496+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.094103865999998, 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:11.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.094055758000003, 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:11.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:11.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.09399355, 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:11.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093945300999998, 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093899952999998, 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:11.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:11.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093853500999998, 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:11.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093807722000001, 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:11.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093762664000003, 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093718205000002, 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093665817000002, 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:11.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:11.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093632734000003, 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.622 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:11.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093547807, 2024-09-21T14:00:11.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093500738000003, 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:11.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093455542999997, 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.093397938000003, 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:11.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.091962148999997, 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.091884028000003, 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:11.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.091834775999999, 2024-09-21T14:00:11.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.655 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.071735946, 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T14:00:11.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T14:00:11.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.781712816999999, 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:11.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:11.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:11.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:11.665 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:11.666 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:11.575+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:11.667 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:11.679 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:11.675+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:11.780 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:11.776+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:11.840 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:11.841 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:11.841 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:11.841 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:11.854 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:11.881 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:11.879+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:11.982 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:11.979+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:12.021 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:12.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:12.083 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:12.079+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:12.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.281393026000003, 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.273515863, 2024-09-21T14:00:12.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:12.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269578840999998, 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:12.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269567632000005, 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:12.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269556460000004, 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:12.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269542157000004, 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:12.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269506696999997, 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.188 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:12.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269493534000006, 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:12.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.269482002999993, 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.197 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:12.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.201 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265494035000003, 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:12.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:12.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:12.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265474402999999, 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:12.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:12.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265449575000005, 2024-09-21T14:00:12.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:12.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:12.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265424577999994, 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:12.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265412507999997, 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.223 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265401187999998, 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:12.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265390046999997, 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.228 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:12.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265377745999999, 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:12.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:12.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:12.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 85.265366494000006, 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:12.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.189296741999996, 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:12.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.180070165999993, 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:12.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.251 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.252 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:12.253 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:12.253 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:12.251+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:12.354 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:12.348+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:12.377 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:222119 3.12 3.598d4212 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.226758+0000", 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.151051603, 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1510995770000001, 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 222119 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226758+0000", 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226758+0000", 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226756+0000", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226767+0000", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1004e-05 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226782+0000", 2024-09-21T14:00:12.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4697e-05 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226789+0000", 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9070000000000001e-06 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226852+0000", 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2923999999999996e-05 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:12.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.226859+0000", 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3130000000000001e-06 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.236267+0000", 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094073769999999998 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.236279+0000", 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2288e-05 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.178370+0000", 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.94209151700000004 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.178401+0000", 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0602000000000003e-05 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:222122 3.12 3.598d4212 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.244724+0000", 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.133085495, 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1332966680000001, 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 222122 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244724+0000", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244724+0000", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244722+0000", 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244733+0000", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1046000000000001e-05 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244757+0000", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4414e-05 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244770+0000", 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2343e-05 2024-09-21T14:00:12.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244849+0000", 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9622000000000004e-05 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.244861+0000", 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1997000000000001e-05 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.178742+0000", 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.93388051000000005 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.178764+0000", 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.226e-05 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:222123 3.12 3.598d4212 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e106)", 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:12.179656+0000", 2024-09-21T14:00:12.388 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.19815381400000001, 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19848775199999999, 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 222123 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179656+0000", 2024-09-21T14:00:12.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179656+0000", 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179653+0000", 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179668+0000", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.466e-05 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179696+0000", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8333000000000001e-05 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.179717+0000", 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0565999999999999e-05 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.180032+0000", 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031553799999999997 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:12.180070+0000", 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7796999999999997e-05 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T14:00:12.392 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-09-21T14:00:12.393 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:12.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:12.455 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:12.451+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:12.556 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:12.552+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:12.559 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:12.559 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:12.559 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:12.559 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:12.559 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:12.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:12.657 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:12.655+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:12.743 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.222367437999999, 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:12.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.222299653, 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:12.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:12.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.22226528, 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:12.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.583461481000001, 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:12.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:12.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:12.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.d 97/95 [PushOp(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f, version: 51'67, data_included: [4390304~608,4407296~10240,4433920~10240,4460544~10240,4487168~10240,4513792~10240,4540416~10240,4567040~10240,4593664~10240,4620288~10240,4646912~10240,4673536~10240,4700160~10240,4726784~10240,4753408~10240,4780032~10240,4806656~10240,4833280~10240,4859904~10240,4882658~2483,4886528~10240,4913152~10240,4939776~10240,4966400~10240,4993024~10240,5019648~10240,5046272~10240,5072896~10240,5099520~10240,5126144~10240,5152768~10240,5179392~10240,5206016~10240,5232640~10240,5259264~10240,5285888~10240,5312512~10240,5339136~10240,5365760~10240,5392384~10240,5419008~10240,5445632~10240,5472256~10240,5498880~10240,5525504~10240,5552128~10240,5578752~10240,5605376~10240,5632000~10240,5658624~10240,5685248~10240,5711872~10240,5738496~10240,5765120~10240,5791744~10240,5818368~10240,5844992~10240,5871616~10240,5898240~10240,5924864~10240,5951488~10240,5978112~10240,6004736~10240,6031360~10240,6057984~10240,6084608~10240,6111232~10240,6137856~10240,6164480~10240,6191104~10240,6217728~10240,6244352~10240,6270976~10240,6297600~10240,6324224~10240,6350848~10240,6377472~10240,6404096~10240,6430720~10240,6457344~10240,6483968~10240,6510592~10240,6537216~10240,6563840~10240,6590464~10240,6617088~10240,6643712~10240,6670336~10240,6696960~10240,6723584~10240,6750208~10240,6776832~10240,6803456~10240,6830080~10240,6856704~10240,6883328~10240,6909952~10240,6936576~10240,6963200~10240,6989824~10240,7016448~10240,7043072~10240,7069696~10240,7096320~10240,7122944~1005], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f@51'67, size: 8384512, copy_subset: [0~8384512], clone_subset: {}, snapset: f=[]:{f=[f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7123949, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:4390304, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.9997790779999995, 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0101314, 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740138+0000", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740716+0000", 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057751700000000005 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740747+0000", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0904000000000001e-05 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740784+0000", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7583999999999998e-05 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740928+0000", 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143523 2024-09-21T14:00:12.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740954+0000", 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6602999999999999e-05 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.750271+0000", 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093164000000000007 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.539188094, 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219975 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4339240689999997, 2024-09-21T14:00:12.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00913279, 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219975 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305993+0000", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306001+0000", 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3100000000000003e-06 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306014+0000", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3752e-05 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306022+0000", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0439999999999996e-06 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306278+0000", 2024-09-21T14:00:12.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025558699999999999 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306517+0000", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023844200000000001 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308497+0000", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001980496 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314906+0000", 2024-09-21T14:00:12.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064086450000000001 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315023+0000", 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116896 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315091+0000", 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8733999999999996e-05 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315127+0000", 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920999999999997e-05 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219977 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4331873929999999, 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085942469999999993, 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219977 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:12.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306730+0000", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306737+0000", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306749+0000", 2024-09-21T14:00:12.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2046e-05 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306756+0000", 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309424+0000", 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026673690000000002 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309503+0000", 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9087999999999999e-05 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309724+0000", 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022127299999999999 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314918+0000", 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051938660000000001 2024-09-21T14:00:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315193+0000", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027556100000000001 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315266+0000", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2804000000000003e-05 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315325+0000", 2024-09-21T14:00:12.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9225999999999998e-05 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219979 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.432367631, 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079712659999999994, 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.784 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219979 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307550+0000", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307555+0000", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307567+0000", 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365999999999999e-05 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307574+0000", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1919999999999999e-06 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310139+0000", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002564804 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310368+0000", 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229712 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.311115+0000", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074702799999999995 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315347+0000", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042319339999999997 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315411+0000", 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4147999999999996e-05 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315474+0000", 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2551999999999993e-05 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315522+0000", 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8087000000000002e-05 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4323272789999999, 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4318356870000004, 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:12.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:12.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4308394609999997, 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4308066579999998, 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:12.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:12.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:12.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:12.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:12.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4299134589999998, 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:12.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:12.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:12.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220003 3.f 3:f6e1ae70:::rbd_data.11853b23d9f4.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.4166777279999998, 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085381020000000005, 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.820 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220003 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323239+0000", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325404+0000", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00216533 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325443+0000", 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8699999999999999e-05 2024-09-21T14:00:12.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325477+0000", 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3701999999999997e-05 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325557+0000", 2024-09-21T14:00:12.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0591000000000001e-05 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325699+0000", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141297 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325961+0000", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026246499999999997 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.330683+0000", 2024-09-21T14:00:12.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047217049999999997 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331665+0000", 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098241499999999994 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331727+0000", 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1682999999999999e-05 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331779+0000", 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1858999999999999e-05 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0192452139999997, 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:12.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:12.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220382 3.13 3:c8829760:::rbd_data.118525f806ac.0000000000000032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4499509929999999, 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082335120000000001, 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220382 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289966+0000", 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289974+0000", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1859999999999992e-06 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289995+0000", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0984000000000001e-05 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290010+0000", 2024-09-21T14:00:12.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4943000000000001e-05 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290152+0000", 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141812 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290168+0000", 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5863e-05 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295016+0000", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048484699999999997 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295216+0000", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019934799999999999 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295483+0000", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026733200000000001 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297485+0000", 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020023150000000002 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298009+0000", 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000523694 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298091+0000", 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1868999999999998e-05 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298201+0000", 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110016 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220387 3.13 3:c8c59167:::rbd_data.118525f806ac.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:12.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.4498781909999998, 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083927050000000003, 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220387 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:12.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290039+0000", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290049+0000", 2024-09-21T14:00:12.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290093+0000", 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3872999999999998e-05 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290108+0000", 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4783000000000001e-05 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290294+0000", 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186529 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290307+0000", 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3223e-05 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296337+0000", 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060297450000000004 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296531+0000", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019349800000000001 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296792+0000", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261692 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297896+0000", 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011032080000000001 2024-09-21T14:00:12.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298324+0000", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042789400000000001 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298386+0000", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2137000000000005e-05 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298433+0000", 2024-09-21T14:00:12.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7336000000000002e-05 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:221754 3.12 e104/98 3:4fe2e3c2:::rbd_data.1185676dd8da.0000000000000005:head v 104'836, mlcod=104'834)", 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.70476122, 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093759350000000002, 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035156+0000", 2024-09-21T14:00:12.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040040+0000", 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048844880000000002 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040069+0000", 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8747000000000001e-05 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040082+0000", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2906e-05 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040147+0000", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5191999999999995e-05 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040183+0000", 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5505e-05 2024-09-21T14:00:12.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044486+0000", 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043030100000000003 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044533+0000", 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7453000000000001e-05 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:221938 3.d 3:b6301d38:::rbd_data.1185676dd8da.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 1900544~4077] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.6444164940000001, 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086218170000000004, 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221938 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:12.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095500+0000", 2024-09-21T14:00:12.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098510+0000", 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030093839999999999 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098535+0000", 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5497e-05 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:12.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098545+0000", 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025e-05 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098629+0000", 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3821999999999998e-05 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098865+0000", 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023626699999999999 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.099378+0000", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051284799999999999 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104029+0000", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046505089999999997 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104039+0000", 2024-09-21T14:00:12.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104087+0000", 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7713000000000002e-05 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104124+0000", 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6746999999999999e-05 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:12.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:12.856 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:12.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:12.857 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:12.852+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:12.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:12.958 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:12.955+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:12.995 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:12.995 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:12.995 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:12.995 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:13.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:13.009 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:13.010 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:13.025 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:13.026 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:13.043 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:13.043 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:13.059 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:13.059 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:13.060 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:13.055+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:13.079 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:13.080 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:13.100 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:13.100 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:13.120 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:13.121 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:13.141 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:13.142 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:13.142 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:13.142 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:13.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:13.162 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:13.159+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:13.232 INFO:teuthology.orchestra.run.smithi079.stdout:5699 write 0xe3505d0 thru 0xe354cc5 (0x46f6 bytes) 2024-09-21T14:00:13.243 INFO:teuthology.orchestra.run.smithi079.stdout:5702 punch from 0xd569f5e to 0xd5735a8, (0x964a bytes) 2024-09-21T14:00:13.243 INFO:teuthology.orchestra.run.smithi079.stdout:5704 writesame 0x8f0d9fb thru 0x8f17c8a data_size 0x4(0xa290 bytes) 2024-09-21T14:00:13.261 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:13.256+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:13.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:00:13.283 INFO:teuthology.orchestra.run.smithi079.stdout:5705 writesame 0x99c80f2 thru 0x99cfda8 data_size 0x1(0x7cb7 bytes) 2024-09-21T14:00:13.309 INFO:teuthology.orchestra.run.smithi079.stdout:5706 read 0xad15604 thru 0xad17054 (0x1a51 bytes) 2024-09-21T14:00:13.309 INFO:teuthology.orchestra.run.smithi079.stdout:5707 write 0xc951bef thru 0xc958c70 (0x7082 bytes) 2024-09-21T14:00:13.321 INFO:teuthology.orchestra.run.smithi079.stdout:5708 writesame 0xa90b43f thru 0xa911db8 data_size 0x17(0x697a bytes) 2024-09-21T14:00:13.334 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:13.334 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:13.350 INFO:teuthology.orchestra.run.smithi079.stdout:5710 trunc from 0xe354cc6 to 0xd5675e 2024-09-21T14:00:13.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:13.403 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:13.403 INFO:teuthology.orchestra.run.smithi079.stdout:5713 clone 36 order 20 su 65536 sc 3 2024-09-21T14:00:13.403 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:13.399+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:13.463 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:13.463+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:13.536 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:13.536 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:13.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:13.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:13.595+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:13.665 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:13.660+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:13.727 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:13.728 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:13.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:13.765 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:13.760+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:13.862 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:13.862 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:13.866 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:13.860+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:13.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:13.966 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:13.963+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:14.002 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.002 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:14.067 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:14.064+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:14.168 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:14.164+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:14.185 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.185 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:14.257 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:00:14.269 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:14.267+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:14.329 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.329 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:14.388 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:14.387+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:14.470 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:14.467+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:14.506 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.506 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:14.570 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:14.568+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:14.671 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:14.671+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:14.683 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.683 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:14.784 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:14.783+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:14.862 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:14.862 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:14.873 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:14.871+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:14.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:14.974 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:14.968+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:15.007 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:15.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:15.107 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:15.104+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:15.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:15.176 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:15.172+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:15.181 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:15.181 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:15.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:15.287 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:15.284+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:15.337 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:15.337 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:15.353 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:15.354 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:15.370 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:15.370 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:15.376 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:15.376 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:15.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:15.375+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:15.386 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:15.386 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:15.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:15.405 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:15.406 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:15.423 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:15.423 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:15.443 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:15.443 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:15.464 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:15.464 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:15.477 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:15.475+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:15.557 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:15.557 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:15.557 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:15.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:15.615 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:15.612+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:15.680 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:15.676+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:15.693 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:15.693 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:15.707 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:15.795 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:15.792+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394684349999999, 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394636241999997, 2024-09-21T14:00:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394574034000001, 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394525784999999, 2024-09-21T14:00:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394480436999999, 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394433984999999, 2024-09-21T14:00:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394388206000002, 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394343147999997, 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394298689000003, 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394246301000003, 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394213217999997, 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394128291000001, 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394081221999997, 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.394036026999999, 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.393978422000004, 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:15.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:15.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.392542632999998, 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.392464511999997, 2024-09-21T14:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.39241526, 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:15.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.372316430000001, 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T14:00:15.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.082293301, 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:15.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:15.969 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:15.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:15.971 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:15.968+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:16.072 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:16.068+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:16.140 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:16.140 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:16.140 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:16.141 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:16.154 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:16.173 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:16.171+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:16.262 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:16.263 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:16.263 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-21T14:00:16.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-21T14:00:16.267 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone35 intact 2024-09-21T14:00:16.274 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:16.271+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:16.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:00:16.328 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:16.328 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:16.328 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:16.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:16.369 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-21T14:00:16.375 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:16.371+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.584512716000006, 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:16.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:16.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.576635553000003, 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572698531, 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:16.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:16.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572687321999993, 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.477 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:16.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:16.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572676150000007, 2024-09-21T14:00:16.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:16.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:16.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572661847000006, 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572626387, 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:16.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.494 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572613223999994, 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:16.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:16.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.572601692999996, 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.502 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568613725000006, 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:16.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:16.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568594093000002, 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:16.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568569264999994, 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:16.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568544267999997, 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:16.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568532198, 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.520 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:16.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568520878000001, 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:16.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568509736999999, 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568497436000001, 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:16.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 89.568486183999994, 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:16.537 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:16.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:16.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.492416431999999, 2024-09-21T14:00:16.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:16.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.483189855999996, 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:16.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:16.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:16.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:16.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:16.551 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:16.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:16.553 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:16.548+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:16.635 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T14:00:16.631+0000 7f74c16a6640 -1 mon.a@0(leader).osd e110 definitely_dead 0 2024-09-21T14:00:16.654 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:16.651+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:16.720 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:16.720 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:16.720 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:16.721 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:16.734 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:16.779 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:16.776+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:16.784 INFO:teuthology.orchestra.run.smithi079.stdout:5715 read 0xb73e5a thru 0xb7f1e5 (0xb38c bytes) 2024-09-21T14:00:16.786 INFO:teuthology.orchestra.run.smithi079.stdout:5716 write 0x573468 thru 0x57f8ee (0xc487 bytes) 2024-09-21T14:00:16.817 INFO:teuthology.orchestra.run.smithi079.stdout:5718 writesame 0x2532dee thru 0x254180d data_size 0x10(0xea20 bytes) 2024-09-21T14:00:16.818 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:16.824 INFO:teuthology.orchestra.run.smithi079.stdout:5720 trunc from 0x254180e to 0x6b402e0 2024-09-21T14:00:16.837 INFO:teuthology.orchestra.run.smithi079.stdout:5723 write 0x2ed075a thru 0x2ed0a6c (0x313 bytes) 2024-09-21T14:00:16.840 INFO:teuthology.orchestra.run.smithi079.stdout:5724 read 0x2993823 thru 0x29a1ee6 (0xe6c4 bytes) 2024-09-21T14:00:16.856 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:16.855+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:16.857 INFO:teuthology.orchestra.run.smithi079.stdout:5725 write 0xb273aaf thru 0xb2761d0 (0x2722 bytes) 2024-09-21T14:00:16.861 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:16.862 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:16.862 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:16.862 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:16.862 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:16.863 INFO:teuthology.orchestra.run.smithi079.stdout:5726 write 0x3db0cfd thru 0x3dc0983 (0xfc87 bytes) 2024-09-21T14:00:16.874 INFO:teuthology.orchestra.run.smithi079.stdout:5728 punch from 0x9bf3216 to 0x9bf4aa5, (0x188f bytes) 2024-09-21T14:00:16.874 INFO:teuthology.orchestra.run.smithi079.stdout:5729 clone 37 order 23 su 65536 sc 7 2024-09-21T14:00:16.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:16.967 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:16.964+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.52668671, 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:17.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:17.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:17.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.526618925000001, 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:17.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:17.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.526584551999999, 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:17.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.887780753000001, 2024-09-21T14:00:17.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:17.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.d 97/95 [PushOp(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f, version: 51'67, data_included: [4390304~608,4407296~10240,4433920~10240,4460544~10240,4487168~10240,4513792~10240,4540416~10240,4567040~10240,4593664~10240,4620288~10240,4646912~10240,4673536~10240,4700160~10240,4726784~10240,4753408~10240,4780032~10240,4806656~10240,4833280~10240,4859904~10240,4882658~2483,4886528~10240,4913152~10240,4939776~10240,4966400~10240,4993024~10240,5019648~10240,5046272~10240,5072896~10240,5099520~10240,5126144~10240,5152768~10240,5179392~10240,5206016~10240,5232640~10240,5259264~10240,5285888~10240,5312512~10240,5339136~10240,5365760~10240,5392384~10240,5419008~10240,5445632~10240,5472256~10240,5498880~10240,5525504~10240,5552128~10240,5578752~10240,5605376~10240,5632000~10240,5658624~10240,5685248~10240,5711872~10240,5738496~10240,5765120~10240,5791744~10240,5818368~10240,5844992~10240,5871616~10240,5898240~10240,5924864~10240,5951488~10240,5978112~10240,6004736~10240,6031360~10240,6057984~10240,6084608~10240,6111232~10240,6137856~10240,6164480~10240,6191104~10240,6217728~10240,6244352~10240,6270976~10240,6297600~10240,6324224~10240,6350848~10240,6377472~10240,6404096~10240,6430720~10240,6457344~10240,6483968~10240,6510592~10240,6537216~10240,6563840~10240,6590464~10240,6617088~10240,6643712~10240,6670336~10240,6696960~10240,6723584~10240,6750208~10240,6776832~10240,6803456~10240,6830080~10240,6856704~10240,6883328~10240,6909952~10240,6936576~10240,6963200~10240,6989824~10240,7016448~10240,7043072~10240,7069696~10240,7096320~10240,7122944~1005], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f@51'67, size: 8384512, copy_subset: [0~8384512], clone_subset: {}, snapset: f=[]:{f=[f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7123949, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:4390304, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.30409835, 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0101314, 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740138+0000", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740716+0000", 2024-09-21T14:00:17.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057751700000000005 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740747+0000", 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0904000000000001e-05 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740784+0000", 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7583999999999998e-05 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740928+0000", 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143523 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740954+0000", 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6602999999999999e-05 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.750271+0000", 2024-09-21T14:00:17.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093164000000000007 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.843507366000001, 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:17.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:17.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219975 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7382433410000004, 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00913279, 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219975 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305993+0000", 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306001+0000", 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3100000000000003e-06 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306014+0000", 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3752e-05 2024-09-21T14:00:17.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306022+0000", 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0439999999999996e-06 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306278+0000", 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025558699999999999 2024-09-21T14:00:17.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306517+0000", 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023844200000000001 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308497+0000", 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001980496 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314906+0000", 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064086450000000001 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315023+0000", 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116896 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315091+0000", 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8733999999999996e-05 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315127+0000", 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920999999999997e-05 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219977 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7375066649999997, 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085942469999999993, 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219977 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306730+0000", 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:17.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306737+0000", 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306749+0000", 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2046e-05 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306756+0000", 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309424+0000", 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026673690000000002 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309503+0000", 2024-09-21T14:00:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9087999999999999e-05 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309724+0000", 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022127299999999999 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314918+0000", 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051938660000000001 2024-09-21T14:00:17.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315193+0000", 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027556100000000001 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315266+0000", 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2804000000000003e-05 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315325+0000", 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9225999999999998e-05 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219979 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7366869030000007, 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079712659999999994, 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219979 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:17.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307550+0000", 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307555+0000", 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307567+0000", 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365999999999999e-05 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307574+0000", 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1919999999999999e-06 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310139+0000", 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002564804 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310368+0000", 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229712 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.311115+0000", 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074702799999999995 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315347+0000", 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042319339999999997 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315411+0000", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4147999999999996e-05 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315474+0000", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2551999999999993e-05 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315522+0000", 2024-09-21T14:00:17.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8087000000000002e-05 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7366465509999998, 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:17.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:17.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7361549590000003, 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.108 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:17.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:17.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7351587330000005, 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:17.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:17.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:17.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7351259300000006, 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:17.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:17.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:17.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7342327310000005, 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:17.127 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:17.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:17.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220003 3.f 3:f6e1ae70:::rbd_data.11853b23d9f4.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7209970000000006, 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085381020000000005, 2024-09-21T14:00:17.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220003 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323239+0000", 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325404+0000", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00216533 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325443+0000", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8699999999999999e-05 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325477+0000", 2024-09-21T14:00:17.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3701999999999997e-05 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325557+0000", 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0591000000000001e-05 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325699+0000", 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141297 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325961+0000", 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026246499999999997 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.330683+0000", 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047217049999999997 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331665+0000", 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098241499999999994 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331727+0000", 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1682999999999999e-05 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331779+0000", 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1858999999999999e-05 2024-09-21T14:00:17.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3235644860000004, 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:17.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:17.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:17.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:17.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220382 3.13 3:c8829760:::rbd_data.118525f806ac.0000000000000032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7542702650000006, 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082335120000000001, 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220382 2024-09-21T14:00:17.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289966+0000", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289974+0000", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1859999999999992e-06 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289995+0000", 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0984000000000001e-05 2024-09-21T14:00:17.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290010+0000", 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4943000000000001e-05 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290152+0000", 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141812 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:17.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290168+0000", 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5863e-05 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295016+0000", 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048484699999999997 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295216+0000", 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019934799999999999 2024-09-21T14:00:17.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295483+0000", 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026733200000000001 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297485+0000", 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020023150000000002 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298009+0000", 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000523694 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298091+0000", 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1868999999999998e-05 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298201+0000", 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110016 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220387 3.13 3:c8c59167:::rbd_data.118525f806ac.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7541974630000006, 2024-09-21T14:00:17.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083927050000000003, 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220387 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:17.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290039+0000", 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:17.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290049+0000", 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290093+0000", 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3872999999999998e-05 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290108+0000", 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4783000000000001e-05 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290294+0000", 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186529 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T14:00:17.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290307+0000", 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3223e-05 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296337+0000", 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060297450000000004 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296531+0000", 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019349800000000001 2024-09-21T14:00:17.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296792+0000", 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261692 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297896+0000", 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011032080000000001 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298324+0000", 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042789400000000001 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298386+0000", 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2137000000000005e-05 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298433+0000", 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7336000000000002e-05 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:221754 3.12 e104/98 3:4fe2e3c2:::rbd_data.1185676dd8da.0000000000000005:head v 104'836, mlcod=104'834)", 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0090804919999998, 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093759350000000002, 2024-09-21T14:00:17.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035156+0000", 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040040+0000", 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048844880000000002 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040069+0000", 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8747000000000001e-05 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040082+0000", 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2906e-05 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040147+0000", 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5191999999999995e-05 2024-09-21T14:00:17.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040183+0000", 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5505e-05 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044486+0000", 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043030100000000003 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044533+0000", 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7453000000000001e-05 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:221938 3.d 3:b6301d38:::rbd_data.1185676dd8da.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 1900544~4077] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.9487357660000004, 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086218170000000004, 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:17.168 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221938 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095500+0000", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098510+0000", 2024-09-21T14:00:17.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030093839999999999 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098535+0000", 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5497e-05 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098545+0000", 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025e-05 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098629+0000", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3821999999999998e-05 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098865+0000", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023626699999999999 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.099378+0000", 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051284799999999999 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104029+0000", 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046505089999999997 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104039+0000", 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:17.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104087+0000", 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7713000000000002e-05 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104124+0000", 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6746999999999999e-05 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:17.174 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:17.176 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:17.172+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:17.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:17.272 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:00:17.277 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:17.275+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:17.277 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.0. 2024-09-21T14:00:17.302 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-21T14:00:17.318 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:17.318 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:17.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:223041 3.1 3.47202501 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-21T14:00:17.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:17.266077+0000", 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.053052509999999997, 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.053076775, 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for peered", 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 223041 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266077+0000", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266077+0000", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266073+0000", 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999962 2024-09-21T14:00:17.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266092+0000", 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9346000000000001e-05 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266141+0000", 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9072e-05 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.266168+0000", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6968999999999999e-05 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.274127+0000", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079583239999999993 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.274140+0000", 2024-09-21T14:00:17.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3577999999999999e-05 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:223042 3.1 3.47202501 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:17.275303+0000", 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.043826759999999999, 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043896294000000002, 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for peered", 2024-09-21T14:00:17.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 223042 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275303+0000", 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275303+0000", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275300+0000", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275309+0000", 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0970000000000006e-06 2024-09-21T14:00:17.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275323+0000", 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4705999999999999e-05 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275334+0000", 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1113e-05 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275623+0000", 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028822800000000002 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:17.275636+0000", 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3671e-05 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:17.327 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:17.328 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 2 2024-09-21T14:00:17.328 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:17.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:17.377 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:17.375+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:17.478 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:17.475+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:17.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:17.499 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:17.499 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:17.499 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:17.499 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:17.499 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:17.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:17.604 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:17.603+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:17.625 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:17.625 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:17.641 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:17.642 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:17.657 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:17.658 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:17.676 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:17.676 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:17.679 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:17.676+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:17.687 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:17.687 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:17.696 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:17.696 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:17.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:17.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:17.738 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:17.738 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:17.758 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:17.758 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:17.780 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:17.776+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:17.838 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:17.838 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:17.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:17.881 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:17.876+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:17.973 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:17.973 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:17.982 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:17.980+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:17.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:18.083 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:18.079+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:18.109 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.109 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:18.208 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:18.207+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:18.291 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:18.280+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:18.292 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.293 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:18.400 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:18.399+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:18.474 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.475 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.486 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:18.483+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:18.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:18.586 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:18.583+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:18.656 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.656 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.670 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:18.716 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:18.715+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:18.788 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:18.788+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:18.838 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.838 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:18.896 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:18.895+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:18.975 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:18.975 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:18.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:19.032 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:19.031+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:19.091 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:19.088+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:19.155 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:19.155 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:19.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:19.192 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:19.191+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:19.298 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:19.288+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:19.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:00:19.315 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:19.315 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:19.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:19.393 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:19.391+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:19.494 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:19.494 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:19.494 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:19.491+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:19.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:19.595 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:19.592+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:19.628 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:19.628 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:19.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:19.731 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:19.728+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:19.747 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone36 from 0xb2761d1 (overlap 0xd5675e) to 0x0 2024-09-21T14:00:19.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:19.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:19.819+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:19.844 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:19.844 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:19.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:19.897 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:19.895+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:19.908 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-21T14:00:19.939 INFO:teuthology.orchestra.run.smithi079.stdout:5730 writesame 0x850ebbc thru 0x851ac81 data_size 0xaf(0xc0c6 bytes) 2024-09-21T14:00:19.951 INFO:teuthology.orchestra.run.smithi079.stdout:5731 read 0x2c6e53d thru 0x2c79c45 (0xb709 bytes) 2024-09-21T14:00:19.951 INFO:teuthology.orchestra.run.smithi079.stdout:5732 read 0x6e9cb68 thru 0x6ea45f5 (0x7a8e bytes) 2024-09-21T14:00:19.951 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:19.951 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:19.951 INFO:teuthology.orchestra.run.smithi079.stdout:5736 read 0x4614db4 thru 0x461d7ff (0x8a4c bytes) 2024-09-21T14:00:19.952 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:19.966 INFO:teuthology.orchestra.run.smithi079.stdout:5737 trunc from 0xb2761d1 to 0x11a778a 2024-09-21T14:00:19.971 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:19.971 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:19.999 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:20.000 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:19.996+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:20.020 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:20.020 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:20.033 INFO:teuthology.orchestra.run.smithi079.stdout:5738 punch from 0x10a2f81 to 0x10b1839, (0xe8b8 bytes) 2024-09-21T14:00:20.033 INFO:teuthology.orchestra.run.smithi079.stdout:5739 punch from 0x10eefba to 0x10f52dd, (0x6323 bytes) 2024-09-21T14:00:20.033 INFO:teuthology.orchestra.run.smithi079.stdout:5741 punch from 0x1dc3bf to 0x1e40a1, (0x7ce2 bytes) 2024-09-21T14:00:20.041 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:20.041 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:20.043 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:20.043 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:20.045 INFO:teuthology.orchestra.run.smithi079.stdout:5742 writesame 0x49215b9 thru 0x4924b37 data_size 0x21(0x357f bytes) 2024-09-21T14:00:20.045 INFO:teuthology.orchestra.run.smithi079.stdout:5743 write 0x133c5ac thru 0x1345241 (0x8c96 bytes) 2024-09-21T14:00:20.047 INFO:teuthology.orchestra.run.smithi079.stdout:5744 write 0x10b70ba thru 0x10beb2f (0x7a76 bytes) 2024-09-21T14:00:20.049 INFO:teuthology.orchestra.run.smithi079.stdout:5745 read 0xd6e713 thru 0xd7df32 (0xf820 bytes) 2024-09-21T14:00:20.050 INFO:teuthology.orchestra.run.smithi079.stdout:5746 punch from 0x4371d03 to 0x437ed9b, (0xd098 bytes) 2024-09-21T14:00:20.050 INFO:teuthology.orchestra.run.smithi079.stdout:5747 write 0x29b735c thru 0x29c5ee3 (0xeb88 bytes) 2024-09-21T14:00:20.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:20.061 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:20.062 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:20.064 INFO:teuthology.orchestra.run.smithi079.stdout:5748 write 0x7f49bc2 thru 0x7f53d10 (0xa14f bytes) 2024-09-21T14:00:20.070 INFO:teuthology.orchestra.run.smithi079.stdout:5749 trunc from 0x7f53d11 to 0x678c63e 2024-09-21T14:00:20.081 INFO:teuthology.orchestra.run.smithi079.stdout:5751 read 0xe82d1f thru 0xe8d4cc (0xa7ae bytes) 2024-09-21T14:00:20.082 INFO:teuthology.orchestra.run.smithi079.stdout:5752 read 0x40627ef thru 0x406dcd9 (0xb4eb bytes) 2024-09-21T14:00:20.082 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:20.082 INFO:teuthology.orchestra.run.smithi079.stdout:5754 read 0x50d79f3 thru 0x50db0ba (0x36c8 bytes) 2024-09-21T14:00:20.082 INFO:teuthology.orchestra.run.smithi079.stdout:5756 read 0x28155ef thru 0x2821fbd (0xc9cf bytes) 2024-09-21T14:00:20.083 INFO:teuthology.orchestra.run.smithi079.stdout:5757 write 0x2017ec7 thru 0x20181c2 (0x2fc bytes) 2024-09-21T14:00:20.084 INFO:teuthology.orchestra.run.smithi079.stdout:5758 write 0x620f1bb thru 0x620ffed (0xe33 bytes) 2024-09-21T14:00:20.085 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:20.085 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:20.087 INFO:teuthology.orchestra.run.smithi079.stdout:5760 read 0x1bc4332 thru 0x1bc7a81 (0x3750 bytes) 2024-09-21T14:00:20.096 INFO:teuthology.orchestra.run.smithi079.stdout:5761 write 0x7dd2f03 thru 0x7dd3711 (0x80f bytes) 2024-09-21T14:00:20.099 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:20.095+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:20.101 INFO:teuthology.orchestra.run.smithi079.stdout:5762 write 0x2e4ad29 thru 0x2e53826 (0x8afe bytes) 2024-09-21T14:00:20.106 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:20.106 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:20.118 INFO:teuthology.orchestra.run.smithi079.stdout:5763 write 0xd5459a4 thru 0xd54e76c (0x8dc9 bytes) 2024-09-21T14:00:20.134 INFO:teuthology.orchestra.run.smithi079.stdout:5764 trunc from 0xd54e76d to 0x53fc5d9 2024-09-21T14:00:20.147 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:20.147 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:20.167 INFO:teuthology.orchestra.run.smithi079.stdout:5767 writesame 0xce0aa7e thru 0xce0fc92 data_size 0x1(0x5215 bytes) 2024-09-21T14:00:20.183 INFO:teuthology.orchestra.run.smithi079.stdout:5769 trunc from 0xce0fc93 to 0x1f50774 2024-09-21T14:00:20.199 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:20.199+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:20.201 INFO:teuthology.orchestra.run.smithi079.stdout:5770 read 0x3a93c8 thru 0x3b6ef6 (0xdb2f bytes) 2024-09-21T14:00:20.201 INFO:teuthology.orchestra.run.smithi079.stdout:5773 read 0x134c249 thru 0x134d599 (0x1351 bytes) 2024-09-21T14:00:20.225 INFO:teuthology.orchestra.run.smithi079.stdout:5774 write 0xcd7613e thru 0xcd7c97f (0x6842 bytes) 2024-09-21T14:00:20.230 INFO:teuthology.orchestra.run.smithi079.stdout:5775 write 0xaad0319 thru 0xaad7013 (0x6cfb bytes) 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.231 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748943638999997, 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:20.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748895531000002, 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748833322999999, 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.240 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:20.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748785073999997, 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748739725999997, 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:20.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748693273999997, 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:20.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748647495, 2024-09-21T14:00:20.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748602437000002, 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:20.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:20.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748557978000001, 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:20.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:20.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748505590000001, 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748472507000002, 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748387579999999, 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:20.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748340511000002, 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:20.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748295315999997, 2024-09-21T14:00:20.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:20.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:20.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.748237711000002, 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:20.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:20.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.746801922000003, 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.746723801000002, 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.304 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.746674548999998, 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:20.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206609 3.1d 3:b90c1f0a:::rbd_data.118551b8ee3.0000000000000000:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.726575719, 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082561894999999996, 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206609 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504054+0000", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504053+0000", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504056+0000", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2390000000000001e-06 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504061+0000", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.504067+0000", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0079999999999999e-06 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586305+0000", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082237856999999998 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586388+0000", 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2503000000000006e-05 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.586616+0000", 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022797599999999999 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:20.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.436552590000002, 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:20.318 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.319 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:20.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5777 read 0x31a4ddd thru 0x31b3c9c (0xeec0 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5778 read 0x96178ae thru 0x9626156 (0xe8a9 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5780 read 0xb77b2c0 thru 0xb77d9ab (0x26ec bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5783 read 0x4a3767a thru 0x4a43a76 (0xc3fd bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5784 punch from 0xc259658 to 0xc264980, (0xb328 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5785 punch from 0xadc1f1a to 0xadca9d3, (0x8ab9 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5787 read 0x74b3ca2 thru 0x74bbd45 (0x80a4 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5788 read 0x47a15b4 thru 0x47a78ca (0x6317 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5791 read 0x7a451dc thru 0x7a52540 (0xd365 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5792 write 0x718fb13 thru 0x7195325 (0x5813 bytes) 2024-09-21T14:00:20.323 INFO:teuthology.orchestra.run.smithi079.stdout:5793 read 0x22dfe2d thru 0x22e7bbc (0x7d90 bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5794 read 0x5e38660 thru 0x5e3ce65 (0x4806 bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5795 write 0x482fce7 thru 0x48374d2 (0x77ec bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5796 read 0x65cc106 thru 0x65d2976 (0x6871 bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5798 punch from 0x2cc981d to 0x2cd8600, (0xede3 bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5799 read 0x2d205a6 thru 0x2d2464f (0x40aa bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5800 write 0x220b0d6 thru 0x220b760 (0x68b bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5803 trunc from 0xcd7c980 to 0xd59dce0 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5804 write 0xa92fea1 thru 0xa93ac27 (0xad87 bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5806 punch from 0xbee643d to 0xbee8998, (0x255b bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5807 write 0x83c06f4 thru 0x83cde8e (0xd79b bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5808 write 0x3dfa5f8 thru 0x3e05611 (0xb01a bytes) 2024-09-21T14:00:20.324 INFO:teuthology.orchestra.run.smithi079.stdout:5809 read 0xa4c0ed7 thru 0xa4c1d1c (0xe46 bytes) 2024-09-21T14:00:20.325 INFO:teuthology.orchestra.run.smithi079.stdout:5810 trunc from 0xd59dce0 to 0x29042dc 2024-09-21T14:00:20.325 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:00:20.325 INFO:teuthology.orchestra.run.smithi079.stdout:5811 read 0xa5e1f9 thru 0xa5e58c (0x394 bytes) 2024-09-21T14:00:20.325 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:20.319+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:20.326 INFO:teuthology.orchestra.run.smithi079.stdout:5813 write 0x39c122b thru 0x39c7082 (0x5e58 bytes) 2024-09-21T14:00:20.326 INFO:teuthology.orchestra.run.smithi079.stdout:5815 read 0x10b3170 thru 0x10bb751 (0x85e2 bytes) 2024-09-21T14:00:20.337 INFO:teuthology.orchestra.run.smithi079.stdout:5816 write 0x521a977 thru 0x521d66e (0x2cf8 bytes) 2024-09-21T14:00:20.421 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:20.416+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:20.450 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:20.450 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:20.450 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:20.450 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:20.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:20.551 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:20.548+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:20.623 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:20.620+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:20.637 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:20.638 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:20.638 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:20.638 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:20.638 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:20.653 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:20.724 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:20.723+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:20.824 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.945286818, 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.937409654999996, 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933472632999994, 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933461424000001, 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933450252, 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933435949, 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933400488999993, 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:20.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:20.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933387326000002, 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.933375795000003, 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.860 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:20.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929387826999999, 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:20.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929368194999995, 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.869 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:20.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929343367000001, 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:20.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.877 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929318370000004, 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:20.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929306299999993, 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:20.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929294979999995, 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:20.886 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.890 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929283838999993, 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929271537999995, 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.895 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 93.929260286000002, 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:20.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:20.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:20.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.853190534000007, 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:20.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:20.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 91.843963958000003, 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:20.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:20.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:20.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:20.913 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:20.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:20.915 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:20.911+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:21.016 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:21.012+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:21.053 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:21.053 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:21.053 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:21.053 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:21.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:21.116 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:21.115+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:21.218 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:21.212+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:21.235 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:21.235 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:21.235 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:21.249 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:21.319 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:21.315+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:21.323 INFO:teuthology.orchestra.run.smithi079.stdout:5817 read 0x34bdd6e thru 0x34ccc03 (0xee96 bytes) 2024-09-21T14:00:21.324 INFO:teuthology.orchestra.run.smithi079.stdout:5820 punch from 0x36e05a9 to 0x36eceee, (0xc945 bytes) 2024-09-21T14:00:21.324 INFO:teuthology.orchestra.run.smithi079.stdout:5822 read 0xb43eb3 thru 0xb4ba5d (0x7bab bytes) 2024-09-21T14:00:21.326 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.326 INFO:teuthology.orchestra.run.smithi079.stdout:5824 read 0xc12d8e thru 0xc1af86 (0x81f9 bytes) 2024-09-21T14:00:21.353 INFO:teuthology.orchestra.run.smithi079.stdout:5827 write 0xbae5db7 thru 0xbae831e (0x2568 bytes) 2024-09-21T14:00:21.359 INFO:teuthology.orchestra.run.smithi079.stdout:5828 read 0x39705af thru 0x3970e51 (0x8a3 bytes) 2024-09-21T14:00:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:5829 writesame 0xe17772c thru 0xe183bc0 data_size 0xa5(0xc495 bytes) 2024-09-21T14:00:21.373 INFO:teuthology.orchestra.run.smithi079.stdout:5830 writesame 0x59c381b thru 0x59d37bf data_size 0x5(0xffa5 bytes) 2024-09-21T14:00:21.404 INFO:teuthology.orchestra.run.smithi079.stdout:5831 trunc from 0xe183bc1 to 0x756b9bb 2024-09-21T14:00:21.419 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:21.415+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:21.428 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:21.428 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:21.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.906821361999999, 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:21.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:21.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.906753577, 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:21.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:21.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:21.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:21.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.906719204000002, 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.439 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:21.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.267915405, 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:21.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.d 97/95 [PushOp(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f, version: 51'67, data_included: [4390304~608,4407296~10240,4433920~10240,4460544~10240,4487168~10240,4513792~10240,4540416~10240,4567040~10240,4593664~10240,4620288~10240,4646912~10240,4673536~10240,4700160~10240,4726784~10240,4753408~10240,4780032~10240,4806656~10240,4833280~10240,4859904~10240,4882658~2483,4886528~10240,4913152~10240,4939776~10240,4966400~10240,4993024~10240,5019648~10240,5046272~10240,5072896~10240,5099520~10240,5126144~10240,5152768~10240,5179392~10240,5206016~10240,5232640~10240,5259264~10240,5285888~10240,5312512~10240,5339136~10240,5365760~10240,5392384~10240,5419008~10240,5445632~10240,5472256~10240,5498880~10240,5525504~10240,5552128~10240,5578752~10240,5605376~10240,5632000~10240,5658624~10240,5685248~10240,5711872~10240,5738496~10240,5765120~10240,5791744~10240,5818368~10240,5844992~10240,5871616~10240,5898240~10240,5924864~10240,5951488~10240,5978112~10240,6004736~10240,6031360~10240,6057984~10240,6084608~10240,6111232~10240,6137856~10240,6164480~10240,6191104~10240,6217728~10240,6244352~10240,6270976~10240,6297600~10240,6324224~10240,6350848~10240,6377472~10240,6404096~10240,6430720~10240,6457344~10240,6483968~10240,6510592~10240,6537216~10240,6563840~10240,6590464~10240,6617088~10240,6643712~10240,6670336~10240,6696960~10240,6723584~10240,6750208~10240,6776832~10240,6803456~10240,6830080~10240,6856704~10240,6883328~10240,6909952~10240,6936576~10240,6963200~10240,6989824~10240,7016448~10240,7043072~10240,7069696~10240,7096320~10240,7122944~1005], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f@51'67, size: 8384512, copy_subset: [0~8384512], clone_subset: {}, snapset: f=[]:{f=[f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7123949, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:4390304, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.684233001999999, 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0101314, 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:21.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740138+0000", 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740716+0000", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057751700000000005 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740747+0000", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0904000000000001e-05 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740784+0000", 2024-09-21T14:00:21.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7583999999999998e-05 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740928+0000", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143523 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740954+0000", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6602999999999999e-05 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.750271+0000", 2024-09-21T14:00:21.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093164000000000007 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.223642018, 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:21.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219975 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.118377992999999, 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00913279, 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219975 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:21.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305993+0000", 2024-09-21T14:00:21.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306001+0000", 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3100000000000003e-06 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306014+0000", 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3752e-05 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306022+0000", 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0439999999999996e-06 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306278+0000", 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025558699999999999 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306517+0000", 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023844200000000001 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308497+0000", 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001980496 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314906+0000", 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064086450000000001 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315023+0000", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116896 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315091+0000", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8733999999999996e-05 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315127+0000", 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920999999999997e-05 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219977 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.117641317, 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085942469999999993, 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219977 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306730+0000", 2024-09-21T14:00:21.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306737+0000", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306749+0000", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2046e-05 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306756+0000", 2024-09-21T14:00:21.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309424+0000", 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026673690000000002 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309503+0000", 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9087999999999999e-05 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309724+0000", 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022127299999999999 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314918+0000", 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051938660000000001 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315193+0000", 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027556100000000001 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315266+0000", 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2804000000000003e-05 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315325+0000", 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9225999999999998e-05 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219979 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.116821555, 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079712659999999994, 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219979 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307550+0000", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307555+0000", 2024-09-21T14:00:21.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307567+0000", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365999999999999e-05 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307574+0000", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1919999999999999e-06 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310139+0000", 2024-09-21T14:00:21.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002564804 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310368+0000", 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229712 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.311115+0000", 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074702799999999995 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315347+0000", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042319339999999997 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315411+0000", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4147999999999996e-05 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315474+0000", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2551999999999993e-05 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315522+0000", 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8087000000000002e-05 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.116781203, 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.116289610999999, 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:21.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.115293384999999, 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:21.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:21.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:21.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.115260581999999, 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:21.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.114367382999999, 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:21.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220003 3.f 3:f6e1ae70:::rbd_data.11853b23d9f4.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.101131651999999, 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085381020000000005, 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220003 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:21.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323239+0000", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325404+0000", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00216533 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325443+0000", 2024-09-21T14:00:21.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8699999999999999e-05 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325477+0000", 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3701999999999997e-05 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325557+0000", 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0591000000000001e-05 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325699+0000", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141297 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325961+0000", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026246499999999997 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.330683+0000", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047217049999999997 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331665+0000", 2024-09-21T14:00:21.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098241499999999994 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331727+0000", 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1682999999999999e-05 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331779+0000", 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1858999999999999e-05 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.703699137999999, 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:21.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220382 3.13 3:c8829760:::rbd_data.118525f806ac.0000000000000032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.134404916999999, 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082335120000000001, 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.515 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220382 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289966+0000", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289974+0000", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1859999999999992e-06 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289995+0000", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0984000000000001e-05 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290010+0000", 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4943000000000001e-05 2024-09-21T14:00:21.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290152+0000", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141812 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290168+0000", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5863e-05 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295016+0000", 2024-09-21T14:00:21.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048484699999999997 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295216+0000", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019934799999999999 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295483+0000", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026733200000000001 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297485+0000", 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020023150000000002 2024-09-21T14:00:21.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298009+0000", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000523694 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298091+0000", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1868999999999998e-05 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298201+0000", 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110016 2024-09-21T14:00:21.520 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220387 3.13 3:c8c59167:::rbd_data.118525f806ac.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.134332114999999, 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083927050000000003, 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220387 2024-09-21T14:00:21.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290039+0000", 2024-09-21T14:00:21.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290049+0000", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290093+0000", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3872999999999998e-05 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290108+0000", 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4783000000000001e-05 2024-09-21T14:00:21.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290294+0000", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186529 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290307+0000", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3223e-05 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296337+0000", 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060297450000000004 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296531+0000", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019349800000000001 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296792+0000", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261692 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297896+0000", 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011032080000000001 2024-09-21T14:00:21.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298324+0000", 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042789400000000001 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298386+0000", 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2137000000000005e-05 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298433+0000", 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7336000000000002e-05 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:221754 3.12 e104/98 3:4fe2e3c2:::rbd_data.1185676dd8da.0000000000000005:head v 104'836, mlcod=104'834)", 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.389215144, 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093759350000000002, 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035156+0000", 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040040+0000", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048844880000000002 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040069+0000", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8747000000000001e-05 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040082+0000", 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2906e-05 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040147+0000", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5191999999999995e-05 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040183+0000", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5505e-05 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044486+0000", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043030100000000003 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044533+0000", 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7453000000000001e-05 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:221938 3.d 3:b6301d38:::rbd_data.1185676dd8da.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 1900544~4077] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.328870417999999, 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086218170000000004, 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:21.531 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221938 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:21.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095500+0000", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098510+0000", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030093839999999999 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098535+0000", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5497e-05 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098545+0000", 2024-09-21T14:00:21.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025e-05 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098629+0000", 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3821999999999998e-05 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098865+0000", 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023626699999999999 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.099378+0000", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051284799999999999 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104029+0000", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046505089999999997 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104039+0000", 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104087+0000", 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7713000000000002e-05 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104124+0000", 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6746999999999999e-05 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:21.536 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:21.538 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:21.532+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:21.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:5833 trunc from 0x756b9bb to 0x9e0b277 2024-09-21T14:00:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:5834 read 0x8008656 thru 0x80153f5 (0xcda0 bytes) 2024-09-21T14:00:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:5836 punch from 0x33709f to 0x34012b, (0x908c bytes) 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5839 read 0x775b3dd thru 0x7767b51 (0xc775 bytes) 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5840 read 0x13ccc3a thru 0x13d2deb (0x61b2 bytes) 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5842 write 0xd94f687 thru 0xd95b495 (0xbe0f bytes) 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5843 trunc from 0xd95b496 to 0xc091c4e 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5844 trunc from 0xc091c4e to 0x716b689 2024-09-21T14:00:21.540 INFO:teuthology.orchestra.run.smithi079.stdout:5845 punch from 0x6627d53 to 0x662f984, (0x7c31 bytes) 2024-09-21T14:00:21.555 INFO:teuthology.orchestra.run.smithi079.stdout:5847 write 0xcd1fca0 thru 0xcd2b974 (0xbcd5 bytes) 2024-09-21T14:00:21.563 INFO:teuthology.orchestra.run.smithi079.stdout:5848 punch from 0x25f8f69 to 0x2601967, (0x89fe bytes) 2024-09-21T14:00:21.578 INFO:teuthology.orchestra.run.smithi079.stdout:5849 write 0xed2c027 thru 0xed34d6b (0x8d45 bytes) 2024-09-21T14:00:21.588 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.588 INFO:teuthology.orchestra.run.smithi079.stdout:5852 write 0x4089eb5 thru 0x408c73d (0x2889 bytes) 2024-09-21T14:00:21.594 INFO:teuthology.orchestra.run.smithi079.stdout:5854 read 0x4d8010d thru 0x4d8df24 (0xde18 bytes) 2024-09-21T14:00:21.596 INFO:teuthology.orchestra.run.smithi079.stdout:5855 punch from 0x36519d4 to 0x365c815, (0xae41 bytes) 2024-09-21T14:00:21.596 INFO:teuthology.orchestra.run.smithi079.stdout:5856 writesame 0xc364457 thru 0xc372f5b data_size 0x15(0xeb05 bytes) 2024-09-21T14:00:21.615 INFO:teuthology.orchestra.run.smithi079.stdout:5857 trunc from 0xed34d6c to 0x9aa6d6d 2024-09-21T14:00:21.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:21.635+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:21.640 INFO:teuthology.orchestra.run.smithi079.stdout:5859 trunc from 0x9aa6d6d to 0xce3fd5d 2024-09-21T14:00:21.652 INFO:teuthology.orchestra.run.smithi079.stdout:5860 writesame 0x97965ca thru 0x979773b data_size 0x1d(0x1172 bytes) 2024-09-21T14:00:21.658 INFO:teuthology.orchestra.run.smithi079.stdout:5862 punch from 0x815cc44 to 0x81604cc, (0x3888 bytes) 2024-09-21T14:00:21.658 INFO:teuthology.orchestra.run.smithi079.stdout:5864 write 0x2f83da4 thru 0x2f8ffb0 (0xc20d bytes) 2024-09-21T14:00:21.662 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:21.662 INFO:teuthology.orchestra.run.smithi079.stdout:5866 punch from 0x43b5a59 to 0x43b5e12, (0x3b9 bytes) 2024-09-21T14:00:21.662 INFO:teuthology.orchestra.run.smithi079.stdout:5867 read 0x9d80363 thru 0x9d86a10 (0x66ae bytes) 2024-09-21T14:00:21.679 INFO:teuthology.orchestra.run.smithi079.stdout:5869 trunc from 0xce3fd5d to 0x319b8ee 2024-09-21T14:00:21.686 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4485.0:224413 3.1b e115/112 3:db03a50a:::rbd_data.1185ddc9253f.0000000000000009:head v 115'347, mlcod=30'3)", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:21.686211+0000", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00065772200000000002, 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000681663, 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686211+0000", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:21.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686211+0000", 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686210+0000", 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686219+0000", 2024-09-21T14:00:21.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1260000000000004e-06 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686233+0000", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4368e-05 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686243+0000", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6500000000000008e-06 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686279+0000", 2024-09-21T14:00:21.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5939000000000003e-05 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.686296+0000", 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6818999999999999e-05 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:21.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:21.691 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-21T14:00:21.691 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:21.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:21.744 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:21.743+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:21.842 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:21.839+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:21.870 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:21.870 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:21.871 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:21.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:21.942 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:21.940+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:22.043 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:22.040+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 99.451110344, 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:22.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T14:00:22.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T14:00:22.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T14:00:22.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.519564603999996, 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T14:00:22.065 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.519549236000003, 2024-09-21T14:00:22.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T14:00:22.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T14:00:22.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.073 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.519534085999993, 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.074 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 85.519498573000007, 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.078 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:22.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T14:00:22.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T14:00:22.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.173791567999999, 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T14:00:22.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:22.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.503768928, 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T14:00:22.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T14:00:22.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.502441218000001, 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T14:00:22.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T14:00:22.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T14:00:22.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.097 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.658260347000002, 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T14:00:22.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T14:00:22.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.658188823000003, 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.103 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T14:00:22.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T14:00:22.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.658093301000001, 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.108 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:22.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T14:00:22.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T14:00:22.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.658037202999999, 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.117 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.658001673000001, 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:22.122 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.657976554000001, 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:22.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T14:00:22.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T14:00:22.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T14:00:22.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207983 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10407936~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695521+0000", 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.361642009999997, 2024-09-21T14:00:22.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051787903000000003, 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207983 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695521+0000", 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695521+0000", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695520+0000", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695523+0000", 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5040000000000001e-06 2024-09-21T14:00:22.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695529+0000", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2129999999999996e-06 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695534+0000", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9099999999999996e-06 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747121+0000", 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051586649999999998 2024-09-21T14:00:22.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747213+0000", 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2442999999999996e-05 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747309+0000", 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5749999999999996e-05 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.361470754999999, 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T14:00:22.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.360187773, 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.360141427000002, 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:22.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T14:00:22.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:22.144 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.353023905000001, 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T14:00:22.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T14:00:22.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224261 3.17 3:ef2aedab:::rbd_data.1185ddc9253f.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3910007~11512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.7165186590000001, 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.98341140100000002, 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224261 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340643+0000", 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:22.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340656+0000", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2653999999999999e-05 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340667+0000", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1542000000000001e-05 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340673+0000", 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T14:00:22.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340731+0000", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7942000000000002e-05 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340745+0000", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320390+0000", 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.97964514800000002 2024-09-21T14:00:22.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320654+0000", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000263823 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320983+0000", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000328771 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323508+0000", 2024-09-21T14:00:22.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025252819999999998 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323545+0000", 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7398999999999999e-05 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323889+0000", 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034357099999999998 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:22.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.324056+0000", 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016691899999999999 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:22.155 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:22.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:22.157 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:22.157 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:22.152+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:22.204 INFO:teuthology.orchestra.run.smithi079.stdout:5870 read 0x30f3afa thru 0x30fb111 (0x7618 bytes) 2024-09-21T14:00:22.205 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:22.206 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:22.206 INFO:teuthology.orchestra.run.smithi079.stdout:5873 write 0x1c42f2 thru 0x1d23b2 (0xe0c1 bytes) 2024-09-21T14:00:22.237 INFO:teuthology.orchestra.run.smithi079.stdout:5874 write 0x8ca0d57 thru 0x8ca2921 (0x1bcb bytes) 2024-09-21T14:00:22.257 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:22.252+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:22.303 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:22.303 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:22.303 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-21T14:00:22.304 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-21T14:00:22.304 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-21T14:00:22.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-21T14:00:22.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T14:00:22.335 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:22.335 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:22.335 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:22.335 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:22.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:22.355 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:22.355 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:22.373 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:22.373 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:22.373 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:22.371+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:22.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:22.393 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:22.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:22.411 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:22.434 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:22.434 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:22.441 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:22.441 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-21T14:00:22.441 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:22.456 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:22.456 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:22.458 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:22.452+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:22.479 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:22.479 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:22.492 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:22.493 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:22.502 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:22.502 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:22.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:22.559 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:22.556+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:22.660 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:22.656+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:22.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:22.761 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:22.756+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:22.832 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:22.833 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:22.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:22.862 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:22.856+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:22.963 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:22.960+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:22.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:23.063 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:23.063+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:23.164 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:23.160+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:23.172 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T14:00:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:5876 read 0x2a7e571 thru 0x2a86ae0 (0x8570 bytes) 2024-09-21T14:00:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:5877 writesame 0x3d125e thru 0x3ddf7b data_size 0x59(0xcd1e bytes) 2024-09-21T14:00:23.265 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:23.260+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:23.366 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:23.360+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.424 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:23.468 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:23.467+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:23.546 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.547 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:23.604 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:23.603+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:23.668 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:23.667+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:23.691 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.691 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:23.768 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:23.764+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:23.827 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:23.827 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:23.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:23.883 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:23.880+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:23.970 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:23.967+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:24.006 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.006 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.020 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:24.071 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:24.067+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:24.135 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.136 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:24.172 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:24.171+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:24.208 INFO:teuthology.orchestra.run.smithi079.stdout:5880 write 0xd0aa774 thru 0xd0b3749 (0x8fd6 bytes) 2024-09-21T14:00:24.214 INFO:teuthology.orchestra.run.smithi079.stdout:5881 read 0x6ec6803 thru 0x6ed4299 (0xda97 bytes) 2024-09-21T14:00:24.214 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.229 INFO:teuthology.orchestra.run.smithi079.stdout:5883 write 0xe508112 thru 0xe50c6f3 (0x45e2 bytes) 2024-09-21T14:00:24.236 INFO:teuthology.orchestra.run.smithi079.stdout:5884 writesame 0x5347ef4 thru 0x53574d6 data_size 0x1(0xf5e3 bytes) 2024-09-21T14:00:24.273 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:24.268+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:24.279 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.279 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.288 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.288 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.288 INFO:teuthology.orchestra.run.smithi079.stdout:5888 punch from 0xbb47d9d to 0xbb51251, (0x94b4 bytes) 2024-09-21T14:00:24.289 INFO:teuthology.orchestra.run.smithi079.stdout:5889 read 0x12fdc84 thru 0x130d7bc (0xfb39 bytes) 2024-09-21T14:00:24.290 INFO:teuthology.orchestra.run.smithi079.stdout:5891 write 0x8632995 thru 0x864046b (0xdad7 bytes) 2024-09-21T14:00:24.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:24.299 INFO:teuthology.orchestra.run.smithi079.stdout:5892 write 0x4154a95 thru 0x415ac4a (0x61b6 bytes) 2024-09-21T14:00:24.303 INFO:teuthology.orchestra.run.smithi079.stdout:5893 read 0xd8ce8a8 thru 0xd8d7a9f (0x91f8 bytes) 2024-09-21T14:00:24.303 INFO:teuthology.orchestra.run.smithi079.stdout:5894 write 0x343560d thru 0x3437738 (0x212c bytes) 2024-09-21T14:00:24.306 INFO:teuthology.orchestra.run.smithi079.stdout:5895 read 0x660b957 thru 0x661aa69 (0xf113 bytes) 2024-09-21T14:00:24.307 INFO:teuthology.orchestra.run.smithi079.stdout:5897 write 0xad7d38 thru 0xadf209 (0x74d2 bytes) 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:5899 punch from 0x9e60ed9 to 0x9e6afc2, (0xa0e9 bytes) 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:5901 punch from 0xae15cd9 to 0xae23c1d, (0xdf44 bytes) 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:5905 read 0x3bd01eb thru 0x3bdf7f6 (0xf60c bytes) 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.311 INFO:teuthology.orchestra.run.smithi079.stdout:5909 writesame 0x51fcb1f thru 0x520919c data_size 0x1b(0xc67e bytes) 2024-09-21T14:00:24.315 INFO:teuthology.orchestra.run.smithi079.stdout:5911 write 0x5063006 thru 0x506da6e (0xaa69 bytes) 2024-09-21T14:00:24.322 INFO:teuthology.orchestra.run.smithi079.stdout:5913 read 0x9014ed3 thru 0x901d3ee (0x851c bytes) 2024-09-21T14:00:24.322 INFO:teuthology.orchestra.run.smithi079.stdout:5914 punch from 0x1ffeec1 to 0x2008c67, (0x9da6 bytes) 2024-09-21T14:00:24.334 INFO:teuthology.orchestra.run.smithi079.stdout:5915 trunc from 0xe50c6f4 to 0xa521603 2024-09-21T14:00:24.358 INFO:teuthology.orchestra.run.smithi079.stdout:5917 writesame 0x760314a thru 0x760b0cf data_size 0x3(0x7f86 bytes) 2024-09-21T14:00:24.368 INFO:teuthology.orchestra.run.smithi079.stdout:5918 writesame 0x7352ac8 thru 0x735e309 data_size 0xa(0xb842 bytes) 2024-09-21T14:00:24.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:24.371+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:24.380 INFO:teuthology.orchestra.run.smithi079.stdout:5919 punch from 0x1f030a6 to 0x1f06bc4, (0x3b1e bytes) 2024-09-21T14:00:24.380 INFO:teuthology.orchestra.run.smithi079.stdout:5921 write 0x2ed2a1d thru 0x2ee1859 (0xee3d bytes) 2024-09-21T14:00:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:5923 read 0x7d9084f thru 0x7d9e1cb (0xd97d bytes) 2024-09-21T14:00:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:5924 read 0x4abb850 thru 0x4abf3b1 (0x3b62 bytes) 2024-09-21T14:00:24.384 INFO:teuthology.orchestra.run.smithi079.stdout:5927 writesame 0x640bb60 thru 0x6414df5 data_size 0x1d(0x9296 bytes) 2024-09-21T14:00:24.407 INFO:teuthology.orchestra.run.smithi079.stdout:5928 trunc from 0xa521603 to 0x2e17f57 2024-09-21T14:00:24.433 INFO:teuthology.orchestra.run.smithi079.stdout:5930 read 0xc3cff thru 0xcfce0 (0xbfe2 bytes) 2024-09-21T14:00:24.434 INFO:teuthology.orchestra.run.smithi079.stdout:5931 write 0xfe1d02 thru 0xfefd2a (0xe029 bytes) 2024-09-21T14:00:24.467 INFO:teuthology.orchestra.run.smithi079.stdout:5932 write 0x85669d8 thru 0x8575c9e (0xf2c7 bytes) 2024-09-21T14:00:24.468 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.468 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.474 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:24.471+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:24.476 INFO:teuthology.orchestra.run.smithi079.stdout:5937 read 0x289da8c thru 0x28ad9bd (0xff32 bytes) 2024-09-21T14:00:24.477 INFO:teuthology.orchestra.run.smithi079.stdout:5938 read 0x40f31e6 thru 0x40f8585 (0x53a0 bytes) 2024-09-21T14:00:24.485 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:24.507 INFO:teuthology.orchestra.run.smithi079.stdout:5939 writesame 0xe30ca91 thru 0xe31bf4d data_size 0x1(0xf4bd bytes) 2024-09-21T14:00:24.508 INFO:teuthology.orchestra.run.smithi079.stdout:5940 write 0x4c3f272 thru 0x4c4b4e2 (0xc271 bytes) 2024-09-21T14:00:24.515 INFO:teuthology.orchestra.run.smithi079.stdout:5941 read 0x88e5148 thru 0x88e59bb (0x874 bytes) 2024-09-21T14:00:24.516 INFO:teuthology.orchestra.run.smithi079.stdout:5943 read 0xe5da20 thru 0xe5ed29 (0x130a bytes) 2024-09-21T14:00:24.517 INFO:teuthology.orchestra.run.smithi079.stdout:5944 read 0xad38865 thru 0xad3f823 (0x6fbf bytes) 2024-09-21T14:00:24.517 INFO:teuthology.orchestra.run.smithi079.stdout:5946 read 0x19e5f01 thru 0x19ee01e (0x811e bytes) 2024-09-21T14:00:24.517 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.518 INFO:teuthology.orchestra.run.smithi079.stdout:5953 writesame 0x20b5cbe thru 0x20c5c22 data_size 0x1(0xff65 bytes) 2024-09-21T14:00:24.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:24.573 INFO:teuthology.orchestra.run.smithi079.stdout:5955 punch from 0x6da416e to 0x6da75e9, (0x347b bytes) 2024-09-21T14:00:24.573 INFO:teuthology.orchestra.run.smithi079.stdout:5956 writesame 0x4c64af1 thru 0x4c6558e data_size 0x9(0xa9e bytes) 2024-09-21T14:00:24.575 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:24.572+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:24.579 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.585 INFO:teuthology.orchestra.run.smithi079.stdout:5958 trunc from 0xe31bf4e to 0xb6cd9d3 2024-09-21T14:00:24.599 INFO:teuthology.orchestra.run.smithi079.stdout:5959 read 0x463dff thru 0x469f03 (0x6105 bytes) 2024-09-21T14:00:24.609 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.609 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.621 INFO:teuthology.orchestra.run.smithi079.stdout:5960 trunc from 0xb6cd9d3 to 0x2dc13a 2024-09-21T14:00:24.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:24.662 INFO:teuthology.orchestra.run.smithi079.stdout:5961 trunc from 0x2dc13a to 0xad57c86 2024-09-21T14:00:24.673 INFO:teuthology.orchestra.run.smithi079.stdout:5962 punch from 0x5a7e60e to 0x5a8beb2, (0xd8a4 bytes) 2024-09-21T14:00:24.685 INFO:teuthology.orchestra.run.smithi079.stdout:5963 write 0xda787f0 thru 0xda8543c (0xcc4d bytes) 2024-09-21T14:00:24.691 INFO:teuthology.orchestra.run.smithi079.stdout:5964 read 0x1f968f6 thru 0x1fa2b98 (0xc2a3 bytes) 2024-09-21T14:00:24.691 INFO:teuthology.orchestra.run.smithi079.stdout:5965 write 0xc1cb0f1 thru 0xc1d44dd (0x93ed bytes) 2024-09-21T14:00:24.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.697 INFO:teuthology.orchestra.run.smithi079.stdout:5967 write 0x71cddbf thru 0x71d3c8c (0x5ece bytes) 2024-09-21T14:00:24.701 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:24.701 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:24.704 INFO:teuthology.orchestra.run.smithi079.stdout:5968 write 0x46e64ba thru 0x46e9ac5 (0x360c bytes) 2024-09-21T14:00:24.710 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:24.708+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:24.713 INFO:teuthology.orchestra.run.smithi079.stdout:5971 trunc from 0xda8543d to 0x9a99548 2024-09-21T14:00:24.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:24.718 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:24.729 INFO:teuthology.orchestra.run.smithi079.stdout:5972 writesame 0x52faaf8 thru 0x52fd7b0 data_size 0x1(0x2cb9 bytes) 2024-09-21T14:00:24.735 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:24.735 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:24.737 INFO:teuthology.orchestra.run.smithi079.stdout:5973 write 0x184d44b thru 0x184e2cf (0xe85 bytes) 2024-09-21T14:00:24.738 INFO:teuthology.orchestra.run.smithi079.stdout:5974 write 0x4b0b57b thru 0x4b124de (0x6f64 bytes) 2024-09-21T14:00:24.747 INFO:teuthology.orchestra.run.smithi079.stdout:5975 trunc from 0x9a99548 to 0xd4a981a 2024-09-21T14:00:24.752 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:24.752 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:24.755 INFO:teuthology.orchestra.run.smithi079.stdout:5976 write 0x45a9f67 thru 0x45b5e69 (0xbf03 bytes) 2024-09-21T14:00:24.760 INFO:teuthology.orchestra.run.smithi079.stdout:5978 read 0x1c7c7fe thru 0x1c8966e (0xce71 bytes) 2024-09-21T14:00:24.761 INFO:teuthology.orchestra.run.smithi079.stdout:5979 writesame 0x6823aa6 thru 0x682a5f2 data_size 0x1(0x6b4d bytes) 2024-09-21T14:00:24.770 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:24.770 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:24.777 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:24.775+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:24.789 INFO:teuthology.orchestra.run.smithi079.stdout:5981 write 0x48a7033 thru 0x48b2e87 (0xbe55 bytes) 2024-09-21T14:00:24.791 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:24.791 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:24.791 INFO:teuthology.orchestra.run.smithi079.stdout:5982 read 0x413cd34 thru 0x4147a5f (0xad2c bytes) 2024-09-21T14:00:24.792 INFO:teuthology.orchestra.run.smithi079.stdout:5983 write 0xb7fb1ef thru 0xb80abb9 (0xf9cb bytes) 2024-09-21T14:00:24.799 INFO:teuthology.orchestra.run.smithi079.stdout:5984 trunc from 0xd4a981a to 0xce0e526 2024-09-21T14:00:24.800 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:24.800 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:24.810 INFO:teuthology.orchestra.run.smithi079.stdout:5985 write 0x717126a thru 0x7177690 (0x6427 bytes) 2024-09-21T14:00:24.811 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:24.811 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:24.815 INFO:teuthology.orchestra.run.smithi079.stdout:5986 punch from 0x7918662 to 0x7918cf5, (0x693 bytes) 2024-09-21T14:00:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:5987 punch from 0x149cdba to 0x14a55ed, (0x8833 bytes) 2024-09-21T14:00:24.816 INFO:teuthology.orchestra.run.smithi079.stdout:5988 write 0xccfc665 thru 0xcd03efb (0x7897 bytes) 2024-09-21T14:00:24.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.818 INFO:teuthology.orchestra.run.smithi079.stdout:5991 writesame 0x7d2a946 thru 0x7d3133b data_size 0x63(0x69f6 bytes) 2024-09-21T14:00:24.820 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-21T14:00:24.820 INFO:teuthology.orchestra.run.smithi079.stdout:5993 punch from 0x9360e96 to 0x936d346, (0xc4b0 bytes) 2024-09-21T14:00:24.820 INFO:teuthology.orchestra.run.smithi079.stdout:5994 writesame 0x1b5003f thru 0x1b58b1b data_size 0x1(0x8add bytes) 2024-09-21T14:00:24.832 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:24.844 INFO:teuthology.orchestra.run.smithi079.stdout:5998 write 0x13f74e thru 0x14e46f (0xed22 bytes) 2024-09-21T14:00:24.846 INFO:teuthology.orchestra.run.smithi079.stdout:5999 writesame 0x6055b9f thru 0x605a0db data_size 0x5(0x453d bytes) 2024-09-21T14:00:24.862 INFO:teuthology.orchestra.run.smithi079.stdout:6000 trunc from 0xce0e526 to 0x471f044 2024-09-21T14:00:24.878 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:24.875+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:24.894 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-21T14:00:24.979 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:24.975+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.108978596, 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.101101432999997, 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:24.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097164410999994, 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:24.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:24.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:24.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:24.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097153202000001, 2024-09-21T14:00:24.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:24.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097142030000001, 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:25.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097127727, 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:25.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:25.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097092266999994, 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.015 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097079104000002, 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:25.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.097067573000004, 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.020 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:25.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.093079605, 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.093059972999995, 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:25.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:25.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.093035145000002, 2024-09-21T14:00:25.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.093010148000005, 2024-09-21T14:00:25.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.092998077999994, 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:25.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:25.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:25.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.092986757999995, 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:25.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:25.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:25.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.092975616999993, 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:25.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.092963315999995, 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:25.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 98.092952064000002, 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:25.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.016882312000007, 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:25.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 96.007655736000004, 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:25.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:25.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.071 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:25.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:25.118 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:25.116+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:25.181 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:25.176+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:25.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:00:25.211 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:25.211 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:25.211 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:25.211 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:25.225 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:25.315 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:25.312+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:25.382 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:25.376+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:25.388 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:25.388 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:25.388 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:25.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:25.483 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:25.479+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:25.569 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.048768215999999, 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:25.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.048700431, 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:25.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.048666057999998, 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:25.579 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:25.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:25.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 25.409862259000001, 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:25.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:25.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.d 97/95 [PushOp(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f, version: 51'67, data_included: [4390304~608,4407296~10240,4433920~10240,4460544~10240,4487168~10240,4513792~10240,4540416~10240,4567040~10240,4593664~10240,4620288~10240,4646912~10240,4673536~10240,4700160~10240,4726784~10240,4753408~10240,4780032~10240,4806656~10240,4833280~10240,4859904~10240,4882658~2483,4886528~10240,4913152~10240,4939776~10240,4966400~10240,4993024~10240,5019648~10240,5046272~10240,5072896~10240,5099520~10240,5126144~10240,5152768~10240,5179392~10240,5206016~10240,5232640~10240,5259264~10240,5285888~10240,5312512~10240,5339136~10240,5365760~10240,5392384~10240,5419008~10240,5445632~10240,5472256~10240,5498880~10240,5525504~10240,5552128~10240,5578752~10240,5605376~10240,5632000~10240,5658624~10240,5685248~10240,5711872~10240,5738496~10240,5765120~10240,5791744~10240,5818368~10240,5844992~10240,5871616~10240,5898240~10240,5924864~10240,5951488~10240,5978112~10240,6004736~10240,6031360~10240,6057984~10240,6084608~10240,6111232~10240,6137856~10240,6164480~10240,6191104~10240,6217728~10240,6244352~10240,6270976~10240,6297600~10240,6324224~10240,6350848~10240,6377472~10240,6404096~10240,6430720~10240,6457344~10240,6483968~10240,6510592~10240,6537216~10240,6563840~10240,6590464~10240,6617088~10240,6643712~10240,6670336~10240,6696960~10240,6723584~10240,6750208~10240,6776832~10240,6803456~10240,6830080~10240,6856704~10240,6883328~10240,6909952~10240,6936576~10240,6963200~10240,6989824~10240,7016448~10240,7043072~10240,7069696~10240,7096320~10240,7122944~1005], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f@51'67, size: 8384512, copy_subset: [0~8384512], clone_subset: {}, snapset: f=[]:{f=[f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7123949, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:4390304, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.826179856, 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0101314, 2024-09-21T14:00:25.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740138+0000", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740716+0000", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057751700000000005 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740747+0000", 2024-09-21T14:00:25.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0904000000000001e-05 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740784+0000", 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7583999999999998e-05 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740928+0000", 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143523 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740954+0000", 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6602999999999999e-05 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.750271+0000", 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093164000000000007 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.365588872, 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:25.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:25.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:25.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219975 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.260324847, 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00913279, 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219975 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305993+0000", 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306001+0000", 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3100000000000003e-06 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306014+0000", 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3752e-05 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306022+0000", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0439999999999996e-06 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306278+0000", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025558699999999999 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306517+0000", 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023844200000000001 2024-09-21T14:00:25.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308497+0000", 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001980496 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314906+0000", 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064086450000000001 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315023+0000", 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116896 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315091+0000", 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8733999999999996e-05 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315127+0000", 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920999999999997e-05 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219977 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.259588171000001, 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085942469999999993, 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.606 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219977 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306730+0000", 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306737+0000", 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306749+0000", 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2046e-05 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306756+0000", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309424+0000", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026673690000000002 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309503+0000", 2024-09-21T14:00:25.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9087999999999999e-05 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309724+0000", 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022127299999999999 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314918+0000", 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051938660000000001 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315193+0000", 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027556100000000001 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315266+0000", 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2804000000000003e-05 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315325+0000", 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9225999999999998e-05 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219979 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.258768408999998, 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079712659999999994, 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219979 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307550+0000", 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307555+0000", 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307567+0000", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365999999999999e-05 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307574+0000", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1919999999999999e-06 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310139+0000", 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002564804 2024-09-21T14:00:25.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310368+0000", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229712 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.311115+0000", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074702799999999995 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315347+0000", 2024-09-21T14:00:25.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042319339999999997 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315411+0000", 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4147999999999996e-05 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315474+0000", 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2551999999999993e-05 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315522+0000", 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8087000000000002e-05 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.258728056999999, 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:25.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:25.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.625 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.258236465, 2024-09-21T14:00:25.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:25.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:25.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:25.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.257240239000001, 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:25.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:25.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:25.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:25.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.257207436000002, 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:25.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.256314237000002, 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:25.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:25.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220003 3.f 3:f6e1ae70:::rbd_data.11853b23d9f4.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.243078506, 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085381020000000005, 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220003 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:25.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323239+0000", 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325404+0000", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00216533 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325443+0000", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8699999999999999e-05 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325477+0000", 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3701999999999997e-05 2024-09-21T14:00:25.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325557+0000", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0591000000000001e-05 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325699+0000", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141297 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325961+0000", 2024-09-21T14:00:25.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026246499999999997 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.330683+0000", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047217049999999997 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331665+0000", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098241499999999994 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331727+0000", 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1682999999999999e-05 2024-09-21T14:00:25.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331779+0000", 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1858999999999999e-05 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.845645992000001, 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:25.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:25.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:25.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:25.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220382 3.13 3:c8829760:::rbd_data.118525f806ac.0000000000000032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.276351771000002, 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082335120000000001, 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220382 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289966+0000", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289974+0000", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1859999999999992e-06 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289995+0000", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0984000000000001e-05 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290010+0000", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4943000000000001e-05 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290152+0000", 2024-09-21T14:00:25.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141812 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290168+0000", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5863e-05 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295016+0000", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048484699999999997 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295216+0000", 2024-09-21T14:00:25.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019934799999999999 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295483+0000", 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026733200000000001 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297485+0000", 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020023150000000002 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298009+0000", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000523694 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298091+0000", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1868999999999998e-05 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298201+0000", 2024-09-21T14:00:25.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110016 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220387 3.13 3:c8c59167:::rbd_data.118525f806ac.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.276278969, 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083927050000000003, 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.669 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220387 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290039+0000", 2024-09-21T14:00:25.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290049+0000", 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290093+0000", 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3872999999999998e-05 2024-09-21T14:00:25.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290108+0000", 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4783000000000001e-05 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290294+0000", 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186529 2024-09-21T14:00:25.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290307+0000", 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3223e-05 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296337+0000", 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060297450000000004 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296531+0000", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019349800000000001 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296792+0000", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261692 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297896+0000", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011032080000000001 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298324+0000", 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042789400000000001 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298386+0000", 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2137000000000005e-05 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298433+0000", 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7336000000000002e-05 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:221754 3.12 e104/98 3:4fe2e3c2:::rbd_data.1185676dd8da.0000000000000005:head v 104'836, mlcod=104'834)", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.531161998, 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093759350000000002, 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035156+0000", 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040040+0000", 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048844880000000002 2024-09-21T14:00:25.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040069+0000", 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8747000000000001e-05 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040082+0000", 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2906e-05 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040147+0000", 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5191999999999995e-05 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040183+0000", 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5505e-05 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044486+0000", 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043030100000000003 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044533+0000", 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7453000000000001e-05 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:221938 3.d 3:b6301d38:::rbd_data.1185676dd8da.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 1900544~4077] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.470817272, 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086218170000000004, 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:25.681 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221938 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095500+0000", 2024-09-21T14:00:25.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:25.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098510+0000", 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030093839999999999 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098535+0000", 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5497e-05 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098545+0000", 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025e-05 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098629+0000", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3821999999999998e-05 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098865+0000", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023626699999999999 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.099378+0000", 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051284799999999999 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104029+0000", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046505089999999997 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104039+0000", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104087+0000", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7713000000000002e-05 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:25.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104124+0000", 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6746999999999999e-05 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:25.689 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:25.690 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:25.688+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:25.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:25.791 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:25.788+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:25.822 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:25.822 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:25.822 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:25.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:25.891 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:25.888+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:25.956 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:25.956 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:25.956 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:25.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:26.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:26.015+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:26.094 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.486533098, 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T14:00:26.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 89.554987358000005, 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:26.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T14:00:26.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:26.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 89.554971989999999, 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:26.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T14:00:26.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 89.554956840000003, 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 89.554921327000002, 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T14:00:26.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T14:00:26.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:26.118 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.209214321999994, 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.122 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.539191681999995, 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T14:00:26.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:26.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:26.128 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.537863971999997, 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T14:00:26.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T14:00:26.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T14:00:26.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693683100999998, 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T14:00:26.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T14:00:26.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T14:00:26.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T14:00:26.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.139 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693611576999999, 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T14:00:26.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693516055000003, 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T14:00:26.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:26.151 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693459957000002, 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T14:00:26.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693424426999997, 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.693399307999996, 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:26.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:26.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.396893509000002, 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:26.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.395610527000002, 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.171 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T14:00:26.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T14:00:26.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.395564180999997, 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T14:00:26.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T14:00:26.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.388446659000003, 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224261 3.17 3:ef2aedab:::rbd_data.1185ddc9253f.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3910007~11512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7519414129999999, 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.98341140100000002, 2024-09-21T14:00:26.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224261 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340643+0000", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340656+0000", 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2653999999999999e-05 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340667+0000", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1542000000000001e-05 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340673+0000", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340731+0000", 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7942000000000002e-05 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340745+0000", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320390+0000", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.97964514800000002 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320654+0000", 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000263823 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320983+0000", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000328771 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323508+0000", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025252819999999998 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323545+0000", 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7398999999999999e-05 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323889+0000", 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034357099999999998 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.324056+0000", 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016691899999999999 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224418 3.6 3:62a11d6e:::rbd_data.1185ddc9253f.0000000000000000:head [stat,truncate 7471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:26.190 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3996874540000004, 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49754111600000001, 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224418 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692896+0000", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692904+0000", 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:26.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692921+0000", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7136e-05 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692933+0000", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1552999999999999e-05 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692994+0000", 2024-09-21T14:00:26.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1197000000000004e-05 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.693006+0000", 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2371000000000001e-05 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185600+0000", 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49259357599999998 2024-09-21T14:00:26.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185989+0000", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038928500000000001 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.186369+0000", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037962400000000001 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.187807+0000", 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014381229999999999 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190326+0000", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025187009999999999 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190385+0000", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9001e-05 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190439+0000", 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4894e-05 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.197 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:26.198 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:26.092+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:26.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:26.199 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:00:26.199 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:26.196+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:26.299 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:26.296+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:26.379 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:26.394 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:26.400 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:26.396+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:26.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:26.499+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:26.516 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:26.516 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:26.516 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:26.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:26.602 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:26.600+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.858290481, 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.718267041, 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T14:00:26.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:26.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T14:00:26.708 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.69000803599999, 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.712 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.792899491, 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T14:00:26.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T14:00:26.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.792838022, 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:26.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T14:00:26.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.721 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.78377404699999, 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T14:00:26.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T14:00:26.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783716287, 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T14:00:26.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783697695, 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T14:00:26.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T14:00:26.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783685357, 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T14:00:26.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T14:00:26.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783663621, 2024-09-21T14:00:26.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.743 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.78364043800001, 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T14:00:26.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783620009, 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:26.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.78360521099999, 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:26.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.78358062700001, 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.757 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T14:00:26.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.783563931, 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T14:00:26.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.78354169399999, 2024-09-21T14:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T14:00:26.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:26.769 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 112.865253391, 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T14:00:26.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:26.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 112.695734843, 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:26.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T14:00:26.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 112.332496249, 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T14:00:26.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.062090656000002, 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T14:00:26.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T14:00:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:26.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:26.793 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:26.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:26.795 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:26.792+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:26.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:26.900 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:26.899+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:26.921 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:26.921 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:26.921 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:26.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:26.996 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:26.992+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:27.005 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:27.006 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:27.022 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:27.022 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:27.038 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:27.038 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:27.055 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:27.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:27.074 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:27.075 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:27.094 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.094 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.094 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:27.095 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:27.097 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:27.095+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:27.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:27.115 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:27.116 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:27.137 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:27.199 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:27.196+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:27.243 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.243 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:27.299 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:27.296+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:27.386 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.386 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.400 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:27.399+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:27.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:27.456 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:27.457 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:27.457 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-21T14:00:27.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-21T14:00:27.536 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:27.535+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:27.574 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.574 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.590 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:27.632 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:27.631+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:27.707 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:27.700+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:27.744 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.744 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:27.811 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:27.808+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:27.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-21T14:00:27.891 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:27.891 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:27.905 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:27.912 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:27.911+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:28.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:28.003+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:28.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-21T14:00:28.070 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.070 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:28.120 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:28.119+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:28.203 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.203 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.209 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:28.204+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:28.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:00:28.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:28.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-21T14:00:28.309 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:28.304+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:28.385 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.385 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:28.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-21T14:00:28.450 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:28.444+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:28.511 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:28.508+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:28.576 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.576 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:28.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-21T14:00:28.635 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:28.632+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:28.712 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:28.711+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:28.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-21T14:00:28.751 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.751 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.766 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:28.814 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:28.808+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:28.883 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:28.883 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:28.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:28.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:28.911+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:28.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-21T14:00:29.032 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:29.031+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:29.062 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:29.062 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:29.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:29.122 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:29.120+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:29.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:29.195 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:29.195 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:29.210 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:29.232 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:29.230+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:29.314 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:29.314 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:29.318 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:29.314+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:29.329 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:29.330 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:29.344 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:29.361 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:00:29.362 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:29.362 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:29.390 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:29.393 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:29.393 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:29.405 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:29.411 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:29.411 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:29.428 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:29.428 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:29.445 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:29.445 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:29.450 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:29.447+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:29.520 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:29.515+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:29.532 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:29.532 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:29.532 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:29.533 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:29.533 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:29.547 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:29.622 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:29.618+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:29.723 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:29.718+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.205899113000001, 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:29.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:29.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.205831327999999, 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:29.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:29.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:29.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:29.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.205796955, 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:29.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.566993155999999, 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.d 97/95 [PushOp(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f, version: 51'67, data_included: [4390304~608,4407296~10240,4433920~10240,4460544~10240,4487168~10240,4513792~10240,4540416~10240,4567040~10240,4593664~10240,4620288~10240,4646912~10240,4673536~10240,4700160~10240,4726784~10240,4753408~10240,4780032~10240,4806656~10240,4833280~10240,4859904~10240,4882658~2483,4886528~10240,4913152~10240,4939776~10240,4966400~10240,4993024~10240,5019648~10240,5046272~10240,5072896~10240,5099520~10240,5126144~10240,5152768~10240,5179392~10240,5206016~10240,5232640~10240,5259264~10240,5285888~10240,5312512~10240,5339136~10240,5365760~10240,5392384~10240,5419008~10240,5445632~10240,5472256~10240,5498880~10240,5525504~10240,5552128~10240,5578752~10240,5605376~10240,5632000~10240,5658624~10240,5685248~10240,5711872~10240,5738496~10240,5765120~10240,5791744~10240,5818368~10240,5844992~10240,5871616~10240,5898240~10240,5924864~10240,5951488~10240,5978112~10240,6004736~10240,6031360~10240,6057984~10240,6084608~10240,6111232~10240,6137856~10240,6164480~10240,6191104~10240,6217728~10240,6244352~10240,6270976~10240,6297600~10240,6324224~10240,6350848~10240,6377472~10240,6404096~10240,6430720~10240,6457344~10240,6483968~10240,6510592~10240,6537216~10240,6563840~10240,6590464~10240,6617088~10240,6643712~10240,6670336~10240,6696960~10240,6723584~10240,6750208~10240,6776832~10240,6803456~10240,6830080~10240,6856704~10240,6883328~10240,6909952~10240,6936576~10240,6963200~10240,6989824~10240,7016448~10240,7043072~10240,7069696~10240,7096320~10240,7122944~1005], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:b4d69bec:::rbd_data.11857a54fb10.0000000000000003:f@51'67, size: 8384512, copy_subset: [0~8384512], clone_subset: {}, snapset: f=[]:{f=[f]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:7123949, data_complete:false, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:4390304, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.983310753000001, 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0101314, 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:29.743 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740139+0000", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740138+0000", 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740716+0000", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057751700000000005 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740747+0000", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0904000000000001e-05 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740784+0000", 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7583999999999998e-05 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740928+0000", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143523 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.740954+0000", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6602999999999999e-05 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:02.750271+0000", 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093164000000000007 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.522719768999998, 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:29.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219975 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.417455744000002, 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00913279, 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219975 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305994+0000", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.305993+0000", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306001+0000", 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3100000000000003e-06 2024-09-21T14:00:29.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306014+0000", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3752e-05 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306022+0000", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0439999999999996e-06 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306278+0000", 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025558699999999999 2024-09-21T14:00:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306517+0000", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023844200000000001 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308497+0000", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001980496 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314906+0000", 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064086450000000001 2024-09-21T14:00:29.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315023+0000", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116896 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315091+0000", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8733999999999996e-05 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315127+0000", 2024-09-21T14:00:29.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920999999999997e-05 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219977 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.416719067999999, 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085942469999999993, 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219977 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306731+0000", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306730+0000", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306737+0000", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7279999999999998e-06 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306749+0000", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2046e-05 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.306756+0000", 2024-09-21T14:00:29.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309424+0000", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026673690000000002 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309503+0000", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9087999999999999e-05 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309724+0000", 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022127299999999999 2024-09-21T14:00:29.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.314918+0000", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051938660000000001 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315193+0000", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027556100000000001 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315266+0000", 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2804000000000003e-05 2024-09-21T14:00:29.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315325+0000", 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9225999999999998e-05 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219979 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.415899306, 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079712659999999994, 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.763 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219979 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307551+0000", 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307550+0000", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307555+0000", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307567+0000", 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365999999999999e-05 2024-09-21T14:00:29.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307574+0000", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1919999999999999e-06 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310139+0000", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002564804 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310368+0000", 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000229712 2024-09-21T14:00:29.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.311115+0000", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074702799999999995 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315347+0000", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042319339999999997 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315411+0000", 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4147999999999996e-05 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315474+0000", 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2551999999999993e-05 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315522+0000", 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8087000000000002e-05 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.768 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.415858954000001, 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:29.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:29.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.415367362000001, 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:29.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.414371136, 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:29.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:29.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:29.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.414338333, 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:29.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:29.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:29.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.413445134, 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:29.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:29.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:29.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220003 3.f 3:f6e1ae70:::rbd_data.11853b23d9f4.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.400209403000002, 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085381020000000005, 2024-09-21T14:00:29.796 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220003 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323241+0000", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323239+0000", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325404+0000", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00216533 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325443+0000", 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8699999999999999e-05 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325477+0000", 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3701999999999997e-05 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325557+0000", 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0591000000000001e-05 2024-09-21T14:00:29.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325699+0000", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141297 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325961+0000", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026246499999999997 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.330683+0000", 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047217049999999997 2024-09-21T14:00:29.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331665+0000", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098241499999999994 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331727+0000", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1682999999999999e-05 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.331779+0000", 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1858999999999999e-05 2024-09-21T14:00:29.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.002776889, 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:29.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:29.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:29.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:29.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220382 3.13 3:c8829760:::rbd_data.118525f806ac.0000000000000032:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.433482668, 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082335120000000001, 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220382 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289967+0000", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289966+0000", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289974+0000", 2024-09-21T14:00:29.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1859999999999992e-06 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.289995+0000", 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0984000000000001e-05 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290010+0000", 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4943000000000001e-05 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290152+0000", 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141812 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290168+0000", 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5863e-05 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295016+0000", 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048484699999999997 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295216+0000", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019934799999999999 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.295483+0000", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00026733200000000001 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297485+0000", 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020023150000000002 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298009+0000", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000523694 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298091+0000", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1868999999999998e-05 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298201+0000", 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110016 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.813 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220387 3.13 3:c8c59167:::rbd_data.118525f806ac.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.433409866000002, 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083927050000000003, 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.814 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220387 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290040+0000", 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290039+0000", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290049+0000", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9599999999999995e-06 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290093+0000", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3872999999999998e-05 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290108+0000", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4783000000000001e-05 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290294+0000", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186529 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.290307+0000", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3223e-05 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296337+0000", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060297450000000004 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296531+0000", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019349800000000001 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.296792+0000", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000261692 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.297896+0000", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011032080000000001 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298324+0000", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042789400000000001 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298386+0000", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2137000000000005e-05 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:08.298433+0000", 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7336000000000002e-05 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:221754 3.12 e104/98 3:4fe2e3c2:::rbd_data.1185676dd8da.0000000000000005:head v 104'836, mlcod=104'834)", 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.688292895, 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0093759350000000002, 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035157+0000", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.035156+0000", 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040040+0000", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048844880000000002 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040069+0000", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8747000000000001e-05 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040082+0000", 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2906e-05 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040147+0000", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5191999999999995e-05 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.040183+0000", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5505e-05 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044486+0000", 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043030100000000003 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.044533+0000", 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7453000000000001e-05 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:221938 3.d 3:b6301d38:::rbd_data.1185676dd8da.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write 1900544~4077] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.627948169, 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0086218170000000004, 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:29.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221938 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:29.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095502+0000", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.095500+0000", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098510+0000", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030093839999999999 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:29.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098535+0000", 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5497e-05 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098545+0000", 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025e-05 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098629+0000", 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3821999999999998e-05 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.098865+0000", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023626699999999999 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.099378+0000", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051284799999999999 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104029+0000", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046505089999999997 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:29.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104039+0000", 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0515e-05 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104087+0000", 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7713000000000002e-05 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:11.104124+0000", 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6746999999999999e-05 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:29.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:29.830 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:29.831 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:29.827+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:29.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:29.932 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:29.930+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:29.964 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:29.964 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:29.964 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:29.964 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:29.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:30.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:30.062+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:30.134 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:30.130+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:30.137 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:30.137 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:30.137 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:30.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:30.235 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:30.231+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:30.312 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:30.312 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:30.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.70372250200001, 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.313 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T14:00:30.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T14:00:30.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.772176762000001, 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.772161393999994, 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:30.326 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.772146243999998, 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:30.330 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 93.772110730999998, 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:30.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T14:00:30.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 87.426403726000004, 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T14:00:30.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.756381086000005, 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.339 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:30.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:30.344 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.755053376000006, 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T14:00:30.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T14:00:30.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T14:00:30.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T14:00:30.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910872505, 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T14:00:30.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910800981000001, 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T14:00:30.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T14:00:30.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910705458999999, 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T14:00:30.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910649360999997, 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T14:00:30.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910613830999999, 2024-09-21T14:00:30.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T14:00:30.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:30.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.910588711999999, 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T14:00:30.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.614082912999997, 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.612799930999998, 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T14:00:30.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.612753585, 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:30.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:30.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 40.605636062999999, 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:30.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T14:00:30.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224261 3.17 3:ef2aedab:::rbd_data.1185ddc9253f.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3910007~11512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.9691308169999999, 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.98341140100000002, 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.399 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224261 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:30.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340643+0000", 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340656+0000", 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2653999999999999e-05 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340667+0000", 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1542000000000001e-05 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340673+0000", 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340731+0000", 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7942000000000002e-05 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340745+0000", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320390+0000", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.97964514800000002 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320654+0000", 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000263823 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320983+0000", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000328771 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323508+0000", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025252819999999998 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323545+0000", 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7398999999999999e-05 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323889+0000", 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034357099999999998 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.324056+0000", 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016691899999999999 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224418 3.6 3:62a11d6e:::rbd_data.1185ddc9253f.0000000000000000:head [stat,truncate 7471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.6168768579999995, 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49754111600000001, 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224418 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692896+0000", 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692904+0000", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692921+0000", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7136e-05 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692933+0000", 2024-09-21T14:00:30.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1552999999999999e-05 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692994+0000", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1197000000000004e-05 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.693006+0000", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2371000000000001e-05 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185600+0000", 2024-09-21T14:00:30.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49259357599999998 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185989+0000", 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038928500000000001 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.186369+0000", 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037962400000000001 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.187807+0000", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014381229999999999 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190326+0000", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025187009999999999 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190385+0000", 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9001e-05 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190439+0000", 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4894e-05 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.412 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:30.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:30.414 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:30.407+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:30.514 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:30.510+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:30.545 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:30.545 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:30.545 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:30.545 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:30.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:30.615 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:30.611+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:30.716 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:30.711+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:30.734 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:30.735 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:30.735 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:30.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:30.816 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:30.814+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.031324674, 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.870 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T14:00:30.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.891301234, 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T14:00:30.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T14:00:30.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T14:00:30.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.863042229, 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T14:00:30.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T14:00:30.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.96593368400001, 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T14:00:30.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.965872215, 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T14:00:30.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.894 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95680824, 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:30.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T14:00:30.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T14:00:30.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95675048, 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T14:00:30.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95673188799999, 2024-09-21T14:00:30.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T14:00:30.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95671955, 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T14:00:30.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T14:00:30.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95669781399999, 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.916 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.956674631, 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T14:00:30.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T14:00:30.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.956654202, 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:30.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T14:00:30.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.956639404, 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:30.925 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:30.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:30.929 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.95661482, 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:30.933 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.956598124, 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T14:00:30.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T14:00:30.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:30.937 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.956575887, 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:30.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T14:00:30.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.038287584, 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T14:00:30.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T14:00:30.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T14:00:30.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 116.868769036, 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:30.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:30.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 116.50553044199999, 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T14:00:30.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T14:00:30.957 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.235124849000002, 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T14:00:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T14:00:30.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T14:00:30.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:30.963 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:30.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:30.965 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:30.962+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:31.066 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:31.059+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:31.134 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:31.134 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:31.134 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:31.134 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:31.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:31.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:31.190+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:31.266 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:31.266 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:31.266 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:31.266 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:31.266 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:31.268 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:31.263+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:31.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:31.372 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:31.370+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:31.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:00:31.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:31.464 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:31.464 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943789611, 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:31.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:31.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:31.469 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943677988, 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:31.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:31.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943658165, 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:31.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.478 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94363398599999, 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:31.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:31.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943609881, 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:31.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:31.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943591372, 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94358163, 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:31.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:31.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943556771, 2024-09-21T14:00:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:31.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943528094, 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:31.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:31.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943509276, 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943488605, 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:31.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:31.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94346753400001, 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:31.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:31.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:31.522 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943431682, 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:31.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:31.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.527 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94339945999999, 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:31.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:31.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94336382, 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.536 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943329342, 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943274782, 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:31.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:31.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:31.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943235617, 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:31.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.94319688100001, 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:31.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 108.943172128, 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:31.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:31.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:31.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:31.560 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:31.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:31.560 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:31.515+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:31.622 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:31.618+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:31.651 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:31.652 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:31.668 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:31.668 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:31.678 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:31.678 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:31.678 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:31.678 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:31.684 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:31.684 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:31.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:31.701 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:31.701 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:31.723 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:31.719+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:31.726 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:31.726 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:31.746 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:31.746 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:31.766 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:31.766 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:31.786 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:31.787 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:31.815 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:31.815 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:31.824 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:31.822+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:31.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:31.924 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:31.922+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:31.991 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:31.991 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:32.048 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:32.046+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:32.126 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:32.122+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:32.137 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.137 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.151 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:32.176 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:00:32.256 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:32.254+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:32.300 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.300 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:32.327 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:32.322+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:32.428 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:32.423+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.439 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:32.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:32.526+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:32.615 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.615 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:32.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:32.626+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:32.730 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:32.723+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:32.859 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:32.855+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:32.931 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:32.926+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:32.946 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:33.038 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:33.035+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:33.114 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.114 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.128 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:33.171 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:33.167+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:33.234 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:33.231+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:33.287 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.288 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:33.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:33.330+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:33.436 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:33.434+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:33.479 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.479 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:33.537 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:33.534+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:33.623 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.623 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:33.638 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:33.631+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:33.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:33.734+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:33.800 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.800 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:33.814 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:33.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:33.846+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:33.931 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:33.931 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:33.940 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:33.935+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:33.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:33.959 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:33.959 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:33.977 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:33.993 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:33.993 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:34.011 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:34.011 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:34.031 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:34.032 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:34.041 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:34.038+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:34.052 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:34.052 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:34.062 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:34.062 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:34.062 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.073 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:34.073 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:34.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:34.094 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:34.094 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:34.142 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:34.135+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:34.146 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:34.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:34.147 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-21T14:00:34.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T14:00:34.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T14:00:34.214 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:34.214 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:34.215 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:34.215 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:34.276 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:34.274+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:34.343 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:34.338+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.80560848899999, 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:34.418 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 97.874062749000004, 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:34.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T14:00:34.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T14:00:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 97.874047380999997, 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T14:00:34.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 97.874032231000001, 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 97.873996718000001, 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T14:00:34.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 91.528289713000007, 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.858267072999993, 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.441 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T14:00:34.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T14:00:34.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T14:00:34.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T14:00:34.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:34.447 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.856939362999995, 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T14:00:34.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T14:00:34.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012758492000003, 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:34.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T14:00:34.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T14:00:34.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012686967999997, 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T14:00:34.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012591446000002, 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T14:00:34.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012535348, 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:34.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012499818000002, 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T14:00:34.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T14:00:34.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.480 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:34.480 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:34.480 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.012474699000002, 2024-09-21T14:00:34.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T14:00:34.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T14:00:34.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.7159689, 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T14:00:34.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.714685918000001, 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.714639572000003, 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:34.500 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 44.707522050000001, 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T14:00:34.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224261 3.17 3:ef2aedab:::rbd_data.1185ddc9253f.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3910007~11512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.071016803999999, 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.98341140100000002, 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224261 2024-09-21T14:00:34.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340643+0000", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340656+0000", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2653999999999999e-05 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340667+0000", 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1542000000000001e-05 2024-09-21T14:00:34.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340673+0000", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340731+0000", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7942000000000002e-05 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340745+0000", 2024-09-21T14:00:34.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320390+0000", 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.97964514800000002 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320654+0000", 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000263823 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:34.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320983+0000", 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000328771 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323508+0000", 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025252819999999998 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323545+0000", 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7398999999999999e-05 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323889+0000", 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034357099999999998 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.324056+0000", 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016691899999999999 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224418 3.6 3:62a11d6e:::rbd_data.1185ddc9253f.0000000000000000:head [stat,truncate 7471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.718762845000001, 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49754111600000001, 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224418 2024-09-21T14:00:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692896+0000", 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692904+0000", 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692921+0000", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7136e-05 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692933+0000", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1552999999999999e-05 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692994+0000", 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1197000000000004e-05 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.693006+0000", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2371000000000001e-05 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185600+0000", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49259357599999998 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185989+0000", 2024-09-21T14:00:34.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038928500000000001 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.186369+0000", 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037962400000000001 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.187807+0000", 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014381229999999999 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190326+0000", 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025187009999999999 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190385+0000", 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9001e-05 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190439+0000", 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4894e-05 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.519 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:34.521 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 128, 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-21T13:57:52.430765+0000", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-21T14:00:34.379356+0000", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-21T13:59:59.502742+0000", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-21T14:00:17.257969+0000", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5801984, 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "noscrub", 2024-09-21T14:00:34.522 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-21T14:00:34.523 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "reef", 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:05.200492+0000", 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:34.524 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-21T14:00:34.525 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "17", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:34.526 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:34.527 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:34.528 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-21T14:00:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.530 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:10.681325+0000", 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:34.531 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:34.532 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "21", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 21, 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:34.533 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:34.534 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:34.535 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:34.536 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9900000095367432, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9900000095367432, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:20.114253+0000", 2024-09-21T14:00:34.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-21T14:00:34.538 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "128", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:34.539 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 49, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 128, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:34.540 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:34.541 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:34.542 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.7400000095367432, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.7400000095367432, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.543 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "4f3cec52-e90a-4dc6-8a9d-879659a7f8b3", 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.545 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6818/3285725925", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6823/3285725925", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/3285725925", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6827/3285725925", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "f30fdaae-2baf-49e5-b8c2-24477eabf5c6", 2024-09-21T14:00:34.549 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.308349609375, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.551 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.553 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.554 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:34.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6819/1533952849", 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6822/1533952849", 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6830/1533952849", 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6826/1533952849", 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T14:00:34.556 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "54acbaba-89a5-4b6c-bd93-89e0683f2125", 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.1219024658203125, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 42, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.557 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.558 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.559 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.560 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.561 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/3403916996", 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/3403916996", 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/3403916996", 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/3403916996", 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T14:00:34.562 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "76fc66bf-6186-4666-b92f-c8093d20d625", 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 118, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.566 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:34.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/3937234571", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/3937234571", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/3937234571", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/3937234571", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c90b7f74-168e-4c89-b1cf-c9ce463afa6e", 2024-09-21T14:00:34.568 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.569 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6824", 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6825", 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.570 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6826", 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6827", 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.571 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6830", 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6831", 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6828", 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6829", 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6825/3468135680", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6827/3468135680", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3468135680", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3468135680", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "b837d993-44f1-4dd3-99f7-675e6abcd9c7", 2024-09-21T14:00:34.574 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 115, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.575 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6816", 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6817", 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6818", 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6819", 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.577 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6822", 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6823", 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6820", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6821", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6817/3245816486", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6819/3245816486", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6823/3245816486", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6821/3245816486", 2024-09-21T14:00:34.579 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c68ceefc-f355-4f66-870e-95ce4a9bc37e", 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:34.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6808", 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6809", 2024-09-21T14:00:34.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6810", 2024-09-21T14:00:34.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6811", 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.583 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6814", 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6815", 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6812", 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6813", 2024-09-21T14:00:34.586 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6809/2399307560", 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6811/2399307560", 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2399307560", 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2399307560", 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.587 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "e1909a46-859c-45e8-b84b-0e11db556c48", 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:34.588 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 13, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 43, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 94, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 115, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 45, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:34.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6800", 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6801", 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.591 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6802", 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6803", 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6806", 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6807", 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6804", 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6805", 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6801/912917640", 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6803/912917640", 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6807/912917640", 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6805/912917640", 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.596 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.368141+0000", 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.597 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343412+0000", 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343898+0000", 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.285851+0000", 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.599 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.330406+0000", 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.151465+0000", 2024-09-21T14:00:34.600 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.197502+0000", 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:34.601 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.171570+0000", 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 45 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-21T14:00:34.602 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 32, 2024-09-21T14:00:34.603 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 6 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [ 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 32, 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.604 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.605 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.606 INFO:tasks.thrashosds.thrasher:j is {'epoch': 128, 'fsid': 'af11199c-39d9-4003-9df0-1f9fd66ab792', 'created': '2024-09-21T13:57:52.430765+0000', 'modified': '2024-09-21T14:00:34.379356+0000', 'last_up_change': '2024-09-21T13:59:59.502742+0000', 'last_in_change': '2024-09-21T14:00:17.257969+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:58:05.200492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T13:58:10.681325+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T13:58:20.114253+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 128, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6818', 'nonce': 3285725925}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 3285725925}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6829', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 3285725925}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6825', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 3285725925}]}, 'public_addr': '172.21.15.79:6818/3285725925', 'cluster_addr': '172.21.15.79:6823/3285725925', 'heartbeat_back_addr': '172.21.15.79:6831/3285725925', 'heartbeat_front_addr': '172.21.15.79:6827/3285725925', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'up': 1, 'in': 1, 'weight': 0.308349609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6817', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1533952849}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6821', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6822', 'nonce': 1533952849}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6830', 'nonce': 1533952849}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6826', 'nonce': 1533952849}]}, 'public_addr': '172.21.15.79:6819/1533952849', 'cluster_addr': '172.21.15.79:6822/1533952849', 'heartbeat_back_addr': '172.21.15.79:6830/1533952849', 'heartbeat_front_addr': '172.21.15.79:6826/1533952849', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '54acbaba-89a5-4b6c-bd93-89e0683f2125', 'up': 1, 'in': 1, 'weight': 0.1219024658203125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 3403916996}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 3403916996}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 3403916996}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 3403916996}]}, 'public_addr': '172.21.15.79:6801/3403916996', 'cluster_addr': '172.21.15.79:6803/3403916996', 'heartbeat_back_addr': '172.21.15.79:6807/3403916996', 'heartbeat_front_addr': '172.21.15.79:6805/3403916996', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76fc66bf-6186-4666-b92f-c8093d20d625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 118, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 3937234571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 3937234571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 3937234571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 3937234571}]}, 'public_addr': '172.21.15.79:6809/3937234571', 'cluster_addr': '172.21.15.79:6811/3937234571', 'heartbeat_back_addr': '172.21.15.79:6815/3937234571', 'heartbeat_front_addr': '172.21.15.79:6813/3937234571', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3468135680}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3468135680}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3468135680}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3468135680}]}, 'public_addr': '172.21.15.134:6825/3468135680', 'cluster_addr': '172.21.15.134:6827/3468135680', 'heartbeat_back_addr': '172.21.15.134:6831/3468135680', 'heartbeat_front_addr': '172.21.15.134:6829/3468135680', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 3245816486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 3245816486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 3245816486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 3245816486}]}, 'public_addr': '172.21.15.134:6817/3245816486', 'cluster_addr': '172.21.15.134:6819/3245816486', 'heartbeat_back_addr': '172.21.15.134:6823/3245816486', 'heartbeat_front_addr': '172.21.15.134:6821/3245816486', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2399307560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2399307560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2399307560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2399307560}]}, 'public_addr': '172.21.15.134:6809/2399307560', 'cluster_addr': '172.21.15.134:6811/2399307560', 'heartbeat_back_addr': '172.21.15.134:6815/2399307560', 'heartbeat_front_addr': '172.21.15.134:6813/2399307560', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e1909a46-859c-45e8-b84b-0e11db556c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 43, 'up_from': 94, 'up_thru': 115, 'down_at': 45, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 912917640}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 912917640}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 912917640}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 912917640}]}, 'public_addr': '172.21.15.134:6801/912917640', 'cluster_addr': '172.21.15.134:6803/912917640', 'heartbeat_back_addr': '172.21.15.134:6807/912917640', 'heartbeat_front_addr': '172.21.15.134:6805/912917640', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.368141+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343412+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343898+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.285851+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.330406+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.151465+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.197502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.171570+0000', 'dead_epoch': 45}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 32, 'length': 6}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 32, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T14:00:34.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:00:34.607 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:34.518+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:34.620 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:34.615+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:34.721 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:34.715+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:34.725 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.725 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:34.725 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:34.726 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:34.823 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:34.819+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:34.855 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:34.855 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:34.856 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:34.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:34.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:00:34.910 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:00:34.923 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:34.919+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:34.926 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-21T14:00:34.383715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1199611543,"num_objects":2240,"num_object_clones":667,"num_object_copies":4480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2240,"num_whiteouts":1156,"num_read":274823,"num_read_kb":922791,"num_write":23285,"num_write_kb":499221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4299,"num_bytes_recovered":402379286,"num_keys_recovered":461,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18546,"ondisk_log_size":18546,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":1117776,"kb_used_data":729980,"kb_used_omap":25,"kb_used_meta":387494,"kb_avail":753856944,"statfs":{"total":773094113280,"available":771949510656,"internally_reserved":0,"allocated":747499520,"data_stored":856685272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":396794867},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-69405249,"num_objects":-59,"num_object_clones":-21,"num_object_copies":-118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-59,"num_whiteouts":-20,"num_read":443,"num_read_kb":377,"num_write":75,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.020143"},"pg_stats":[{"pgid":"3.1f","version":"123'344","reported_seq":2753,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.383756+0000","last_change":"2024-09-21T14:00:29.383756+0000","last_active":"2024-09-21T14:00:29.383756+0000","last_peered":"2024-09-21T14:00:29.383756+0000","last_clean":"2024-09-21T14:00:29.383756+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:00:29.383756+0000","last_undegraded":"2024-09-21T14:00:29.383756+0000","last_fullsized":"2024-09-21T14:00:29.383756+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0040811010000000002,"stat_sum":{"num_bytes":16273276,"num_objects":59,"num_object_clones":13,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":27,"num_read":2687,"num_read_kb":8822,"num_write":402,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.1e","version":"123'843","reported_seq":18327,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.457776+0000","last_change":"2024-09-21T14:00:29.372109+0000","last_active":"2024-09-21T14:00:29.457776+0000","last_peered":"2024-09-21T14:00:29.457776+0000","last_clean":"2024-09-21T14:00:29.457776+0000","last_became_active":"2024-09-21T13:58:21.657660+0000","last_became_peered":"2024-09-21T13:58:21.657660+0000","last_unstale":"2024-09-21T14:00:29.457776+0000","last_undegraded":"2024-09-21T14:00:29.457776+0000","last_fullsized":"2024-09-21T14:00:29.457776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:39:37.579715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094572899999999997,"stat_sum":{"num_bytes":78256011,"num_objects":91,"num_object_clones":30,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":41,"num_read":21279,"num_read_kb":57003,"num_write":1109,"num_write_kb":26371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.1d","version":"123'755","reported_seq":6933,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.469046+0000","last_change":"2024-09-21T14:00:29.374882+0000","last_active":"2024-09-21T14:00:29.469046+0000","last_peered":"2024-09-21T14:00:29.469046+0000","last_clean":"2024-09-21T14:00:29.469046+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:00:29.469046+0000","last_undegraded":"2024-09-21T14:00:29.469046+0000","last_fullsized":"2024-09-21T14:00:29.469046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0082389000000000004,"stat_sum":{"num_bytes":51006425,"num_objects":73,"num_object_clones":23,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":38,"num_read":9846,"num_read_kb":39488,"num_write":895,"num_write_kb":17690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.1c","version":"123'433","reported_seq":3700,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.418571+0000","last_change":"2024-09-21T14:00:29.369022+0000","last_active":"2024-09-21T14:00:29.418571+0000","last_peered":"2024-09-21T14:00:29.418571+0000","last_clean":"2024-09-21T14:00:29.418571+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:00:29.418571+0000","last_undegraded":"2024-09-21T14:00:29.418571+0000","last_fullsized":"2024-09-21T14:00:29.418571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003242885,"stat_sum":{"num_bytes":23413366,"num_objects":79,"num_object_clones":22,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":4998,"num_read_kb":19391,"num_write":584,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.1b","version":"123'367","reported_seq":1695,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.380374+0000","last_change":"2024-09-21T14:00:29.380374+0000","last_active":"2024-09-21T14:00:29.380374+0000","last_peered":"2024-09-21T14:00:29.380374+0000","last_clean":"2024-09-21T14:00:29.380374+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:00:29.380374+0000","last_undegraded":"2024-09-21T14:00:29.380374+0000","last_fullsized":"2024-09-21T14:00:29.380374+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085032,"stat_sum":{"num_bytes":27347775,"num_objects":71,"num_object_clones":20,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":41,"num_read":1176,"num_read_kb":12003,"num_write":409,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.1a","version":"123'640","reported_seq":18963,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.452447+0000","last_change":"2024-09-21T14:00:29.366874+0000","last_active":"2024-09-21T14:00:29.452447+0000","last_peered":"2024-09-21T14:00:29.452447+0000","last_clean":"2024-09-21T14:00:29.452447+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:00:29.452447+0000","last_undegraded":"2024-09-21T14:00:29.452447+0000","last_fullsized":"2024-09-21T14:00:29.452447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020265980000000001,"stat_sum":{"num_bytes":25615057,"num_objects":84,"num_object_clones":27,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":41,"num_read":19111,"num_read_kb":28760,"num_write":794,"num_write_kb":13061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.19","version":"122'380","reported_seq":5208,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.371422+0000","last_change":"2024-09-21T14:00:29.371627+0000","last_active":"2024-09-21T14:00:29.371422+0000","last_peered":"2024-09-21T14:00:29.371422+0000","last_clean":"2024-09-21T14:00:29.371422+0000","last_became_active":"2024-09-21T13:58:43.296981+0000","last_became_peered":"2024-09-21T13:58:43.296981+0000","last_unstale":"2024-09-21T14:00:29.371422+0000","last_undegraded":"2024-09-21T14:00:29.371422+0000","last_fullsized":"2024-09-21T14:00:29.371422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:31:15.232425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076886900000000004,"stat_sum":{"num_bytes":34226172,"num_objects":70,"num_object_clones":17,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":34,"num_read":4786,"num_read_kb":32857,"num_write":369,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":1534085,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.18","version":"113'589","reported_seq":35190,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.370939+0000","last_change":"2024-09-21T14:00:29.371196+0000","last_active":"2024-09-21T14:00:29.370939+0000","last_peered":"2024-09-21T14:00:29.370939+0000","last_clean":"2024-09-21T14:00:29.370939+0000","last_became_active":"2024-09-21T14:00:25.183553+0000","last_became_peered":"2024-09-21T14:00:25.183553+0000","last_unstale":"2024-09-21T14:00:29.370939+0000","last_undegraded":"2024-09-21T14:00:29.370939+0000","last_fullsized":"2024-09-21T14:00:29.370939+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:43.554245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038446500000000001,"stat_sum":{"num_bytes":59795469,"num_objects":65,"num_object_clones":16,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":33,"num_read":35820,"num_read_kb":77041,"num_write":657,"num_write_kb":11052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":210,"num_bytes_recovered":15644218,"num_keys_recovered":72,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.17","version":"122'355","reported_seq":1932,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.383850+0000","last_change":"2024-09-21T14:00:29.384030+0000","last_active":"2024-09-21T14:00:29.383850+0000","last_peered":"2024-09-21T14:00:29.383850+0000","last_clean":"2024-09-21T14:00:29.383850+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:00:29.383850+0000","last_undegraded":"2024-09-21T14:00:29.383850+0000","last_fullsized":"2024-09-21T14:00:29.383850+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042122189999999997,"stat_sum":{"num_bytes":37682710,"num_objects":72,"num_object_clones":25,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":37,"num_read":1068,"num_read_kb":37860,"num_write":352,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.16","version":"123'501","reported_seq":2846,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.467775+0000","last_change":"2024-09-21T14:00:29.380559+0000","last_active":"2024-09-21T14:00:29.467775+0000","last_peered":"2024-09-21T14:00:29.467775+0000","last_clean":"2024-09-21T14:00:29.467775+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:00:29.467775+0000","last_undegraded":"2024-09-21T14:00:29.467775+0000","last_fullsized":"2024-09-21T14:00:29.467775+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.01419693,"stat_sum":{"num_bytes":24888417,"num_objects":77,"num_object_clones":22,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":42,"num_read":3632,"num_read_kb":24890,"num_write":638,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.15","version":"126'446","reported_seq":2609,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.389476+0000","last_change":"2024-09-21T14:00:33.390676+0000","last_active":"2024-09-21T14:00:33.389476+0000","last_peered":"2024-09-21T14:00:33.389476+0000","last_clean":"2024-09-21T14:00:33.389476+0000","last_became_active":"2024-09-21T14:00:05.192714+0000","last_became_peered":"2024-09-21T14:00:05.192714+0000","last_unstale":"2024-09-21T14:00:33.389476+0000","last_undegraded":"2024-09-21T14:00:33.389476+0000","last_fullsized":"2024-09-21T14:00:33.389476+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:33:01.181490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013786969999999999,"stat_sum":{"num_bytes":37967466,"num_objects":83,"num_object_clones":27,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":49,"num_read":2678,"num_read_kb":22110,"num_write":413,"num_write_kb":15013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":12784428,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]},{"pgid":"3.14","version":"122'350","reported_seq":2003,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.365125+0000","last_change":"2024-09-21T14:00:29.365562+0000","last_active":"2024-09-21T14:00:29.365125+0000","last_peered":"2024-09-21T14:00:29.365125+0000","last_clean":"2024-09-21T14:00:29.365125+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:00:29.365125+0000","last_undegraded":"2024-09-21T14:00:29.365125+0000","last_fullsized":"2024-09-21T14:00:29.365125+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070785300000000004,"stat_sum":{"num_bytes":32171454,"num_objects":69,"num_object_clones":20,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":36,"num_read":1610,"num_read_kb":13801,"num_write":337,"num_write_kb":9505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.358869+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:00:28.358869+0000","last_peered":"2024-09-21T14:00:28.358869+0000","last_clean":"2024-09-21T14:00:28.358869+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:00:28.358869+0000","last_undegraded":"2024-09-21T14:00:28.358869+0000","last_fullsized":"2024-09-21T14:00:28.358869+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"122'392","reported_seq":2289,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.380422+0000","last_change":"2024-09-21T14:00:29.380794+0000","last_active":"2024-09-21T14:00:29.380422+0000","last_peered":"2024-09-21T14:00:29.380422+0000","last_clean":"2024-09-21T14:00:29.380422+0000","last_became_active":"2024-09-21T14:00:22.183588+0000","last_became_peered":"2024-09-21T14:00:22.183588+0000","last_unstale":"2024-09-21T14:00:29.380422+0000","last_undegraded":"2024-09-21T14:00:29.380422+0000","last_fullsized":"2024-09-21T14:00:29.380422+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:00:05.200800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001250765,"stat_sum":{"num_bytes":33639747,"num_objects":54,"num_object_clones":15,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":2109,"num_read_kb":10055,"num_write":488,"num_write_kb":11219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.359175+0000","last_change":"2024-09-21T13:58:43.299441+0000","last_active":"2024-09-21T14:00:28.359175+0000","last_peered":"2024-09-21T14:00:28.359175+0000","last_clean":"2024-09-21T14:00:28.359175+0000","last_became_active":"2024-09-21T13:58:43.298888+0000","last_became_peered":"2024-09-21T13:58:43.298888+0000","last_unstale":"2024-09-21T14:00:28.359175+0000","last_undegraded":"2024-09-21T14:00:28.359175+0000","last_fullsized":"2024-09-21T14:00:28.359175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:20:39.790560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"123'588","reported_seq":4515,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.470685+0000","last_change":"2024-09-21T14:00:29.376656+0000","last_active":"2024-09-21T14:00:29.470685+0000","last_peered":"2024-09-21T14:00:29.470685+0000","last_clean":"2024-09-21T14:00:29.470685+0000","last_became_active":"2024-09-21T14:00:04.185949+0000","last_became_peered":"2024-09-21T14:00:04.185949+0000","last_unstale":"2024-09-21T14:00:29.470685+0000","last_undegraded":"2024-09-21T14:00:29.470685+0000","last_fullsized":"2024-09-21T14:00:29.470685+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:10:23.954590+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0053145390000000001,"stat_sum":{"num_bytes":32283035,"num_objects":95,"num_object_clones":29,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":50,"num_read":5615,"num_read_kb":23653,"num_write":706,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":103,"num_bytes_recovered":7091657,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T14:00:32.174164+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:00:32.174164+0000","last_peered":"2024-09-21T14:00:32.174164+0000","last_clean":"2024-09-21T14:00:32.174164+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:00:32.174164+0000","last_undegraded":"2024-09-21T14:00:32.174164+0000","last_fullsized":"2024-09-21T14:00:32.174164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"123'848","reported_seq":6944,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.371524+0000","last_change":"2024-09-21T14:00:29.371524+0000","last_active":"2024-09-21T14:00:29.371524+0000","last_peered":"2024-09-21T14:00:29.371524+0000","last_clean":"2024-09-21T14:00:29.371524+0000","last_became_active":"2024-09-21T14:00:22.184215+0000","last_became_peered":"2024-09-21T14:00:22.184215+0000","last_unstale":"2024-09-21T14:00:29.371524+0000","last_undegraded":"2024-09-21T14:00:29.371524+0000","last_fullsized":"2024-09-21T14:00:29.371524+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:52:45.996905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056124199999999999,"stat_sum":{"num_bytes":28185364,"num_objects":86,"num_object_clones":30,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":44,"num_read":8004,"num_read_kb":19721,"num_write":1120,"num_write_kb":7166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":392,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.354932+0000","last_change":"2024-09-21T14:00:18.284581+0000","last_active":"2024-09-21T14:00:28.354932+0000","last_peered":"2024-09-21T14:00:28.354932+0000","last_clean":"2024-09-21T14:00:28.354932+0000","last_became_active":"2024-09-21T14:00:18.283835+0000","last_became_peered":"2024-09-21T14:00:18.283835+0000","last_unstale":"2024-09-21T14:00:28.354932+0000","last_undegraded":"2024-09-21T14:00:28.354932+0000","last_fullsized":"2024-09-21T14:00:28.354932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:36:15.779160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"123'668","reported_seq":19565,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.464604+0000","last_change":"2024-09-21T14:00:29.379731+0000","last_active":"2024-09-21T14:00:29.464604+0000","last_peered":"2024-09-21T14:00:29.464604+0000","last_clean":"2024-09-21T14:00:29.464604+0000","last_became_active":"2024-09-21T13:58:21.663305+0000","last_became_peered":"2024-09-21T13:58:21.663305+0000","last_unstale":"2024-09-21T14:00:29.464604+0000","last_undegraded":"2024-09-21T14:00:29.464604+0000","last_fullsized":"2024-09-21T14:00:29.464604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":668,"log_dups_size":0,"ondisk_log_size":668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:22:31.775393+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.012960225000000001,"stat_sum":{"num_bytes":66260212,"num_objects":81,"num_object_clones":26,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":37,"num_read":21573,"num_read_kb":61761,"num_write":763,"num_write_kb":24172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.3","version":"123'459","reported_seq":1461,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.470763+0000","last_change":"2024-09-21T14:00:29.367207+0000","last_active":"2024-09-21T14:00:29.470763+0000","last_peered":"2024-09-21T14:00:29.470763+0000","last_clean":"2024-09-21T14:00:29.470763+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:00:29.470763+0000","last_undegraded":"2024-09-21T14:00:29.470763+0000","last_fullsized":"2024-09-21T14:00:29.470763+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022246470000000002,"stat_sum":{"num_bytes":16829897,"num_objects":56,"num_object_clones":17,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":35,"num_read":1274,"num_read_kb":10337,"num_write":536,"num_write_kb":9154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.2","version":"21'2","reported_seq":144,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.352114+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:00:28.352114+0000","last_peered":"2024-09-21T14:00:28.352114+0000","last_clean":"2024-09-21T14:00:28.352114+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:00:28.352114+0000","last_undegraded":"2024-09-21T14:00:28.352114+0000","last_fullsized":"2024-09-21T14:00:28.352114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"123'2471","reported_seq":21831,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.464020+0000","last_change":"2024-09-21T14:00:29.382674+0000","last_active":"2024-09-21T14:00:29.464020+0000","last_peered":"2024-09-21T14:00:29.464020+0000","last_clean":"2024-09-21T14:00:29.464020+0000","last_became_active":"2024-09-21T14:00:24.178975+0000","last_became_peered":"2024-09-21T14:00:24.178975+0000","last_unstale":"2024-09-21T14:00:29.464020+0000","last_undegraded":"2024-09-21T14:00:29.464020+0000","last_fullsized":"2024-09-21T14:00:29.464020+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2471,"log_dups_size":0,"ondisk_log_size":2471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:49:27.520003+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0061512540000000001,"stat_sum":{"num_bytes":38488981,"num_objects":86,"num_object_clones":26,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":46,"num_read":31200,"num_read_kb":40385,"num_write":4222,"num_write_kb":13670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.351582+0000","last_change":"2024-09-21T14:00:18.281633+0000","last_active":"2024-09-21T14:00:28.351582+0000","last_peered":"2024-09-21T14:00:28.351582+0000","last_clean":"2024-09-21T14:00:28.351582+0000","last_became_active":"2024-09-21T14:00:18.280820+0000","last_became_peered":"2024-09-21T14:00:18.280820+0000","last_unstale":"2024-09-21T14:00:28.351582+0000","last_undegraded":"2024-09-21T14:00:28.351582+0000","last_fullsized":"2024-09-21T14:00:28.351582+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:26:10.227650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"123'531","reported_seq":4734,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.467365+0000","last_change":"2024-09-21T14:00:29.383998+0000","last_active":"2024-09-21T14:00:29.467365+0000","last_peered":"2024-09-21T14:00:29.467365+0000","last_clean":"2024-09-21T14:00:29.467365+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:00:29.467365+0000","last_undegraded":"2024-09-21T14:00:29.467365+0000","last_fullsized":"2024-09-21T14:00:29.467365+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0048048700000000001,"stat_sum":{"num_bytes":64697799,"num_objects":71,"num_object_clones":22,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":33,"num_read":5800,"num_read_kb":28291,"num_write":642,"num_write_kb":24572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":103,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T14:00:32.173867+0000","last_change":"2024-09-21T14:00:18.289521+0000","last_active":"2024-09-21T14:00:32.173867+0000","last_peered":"2024-09-21T14:00:32.173867+0000","last_clean":"2024-09-21T14:00:32.173867+0000","last_became_active":"2024-09-21T14:00:18.288773+0000","last_became_peered":"2024-09-21T14:00:18.288773+0000","last_unstale":"2024-09-21T14:00:32.173867+0000","last_undegraded":"2024-09-21T14:00:32.173867+0000","last_fullsized":"2024-09-21T14:00:32.173867+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:15:37.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"123'474","reported_seq":19382,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.467763+0000","last_change":"2024-09-21T14:00:29.372085+0000","last_active":"2024-09-21T14:00:29.467763+0000","last_peered":"2024-09-21T14:00:29.467763+0000","last_clean":"2024-09-21T14:00:29.467763+0000","last_became_active":"2024-09-21T13:58:21.666129+0000","last_became_peered":"2024-09-21T13:58:21.666129+0000","last_unstale":"2024-09-21T14:00:29.467763+0000","last_undegraded":"2024-09-21T14:00:29.467763+0000","last_fullsized":"2024-09-21T14:00:29.467763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:36:34.646744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102144,"stat_sum":{"num_bytes":58006138,"num_objects":67,"num_object_clones":17,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":34,"num_read":20805,"num_read_kb":66613,"num_write":523,"num_write_kb":24419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"2.3","version":"19'1","reported_seq":141,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-21T14:00:28.352103+0000","last_change":"2024-09-21T14:00:02.051110+0000","last_active":"2024-09-21T14:00:28.352103+0000","last_peered":"2024-09-21T14:00:28.352103+0000","last_clean":"2024-09-21T14:00:28.352103+0000","last_became_active":"2024-09-21T14:00:01.844490+0000","last_became_peered":"2024-09-21T14:00:01.844490+0000","last_unstale":"2024-09-21T14:00:28.352103+0000","last_undegraded":"2024-09-21T14:00:28.352103+0000","last_fullsized":"2024-09-21T14:00:28.352103+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:47:44.598563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":245,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-21T14:00:32.173834+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:00:32.173834+0000","last_peered":"2024-09-21T14:00:32.173834+0000","last_clean":"2024-09-21T14:00:32.173834+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:00:32.173834+0000","last_undegraded":"2024-09-21T14:00:32.173834+0000","last_fullsized":"2024-09-21T14:00:32.173834+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"118'421","reported_seq":2902,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.370989+0000","last_change":"2024-09-21T14:00:29.371192+0000","last_active":"2024-09-21T14:00:29.370989+0000","last_peered":"2024-09-21T14:00:29.370989+0000","last_clean":"2024-09-21T14:00:29.370989+0000","last_became_active":"2024-09-21T14:00:05.192851+0000","last_became_peered":"2024-09-21T14:00:05.192851+0000","last_unstale":"2024-09-21T14:00:29.370989+0000","last_undegraded":"2024-09-21T14:00:29.370989+0000","last_fullsized":"2024-09-21T14:00:29.370989+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:09.295030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034308199999999998,"stat_sum":{"num_bytes":17074315,"num_objects":67,"num_object_clones":20,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":35,"num_read":3277,"num_read_kb":11896,"num_write":411,"num_write_kb":7943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":4959511,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.9","version":"123'361","reported_seq":2266,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.367721+0000","last_change":"2024-09-21T14:00:29.367721+0000","last_active":"2024-09-21T14:00:29.367721+0000","last_peered":"2024-09-21T14:00:29.367721+0000","last_clean":"2024-09-21T14:00:29.367721+0000","last_became_active":"2024-09-21T14:00:05.192351+0000","last_became_peered":"2024-09-21T14:00:05.192351+0000","last_unstale":"2024-09-21T14:00:29.367721+0000","last_undegraded":"2024-09-21T14:00:29.367721+0000","last_fullsized":"2024-09-21T14:00:29.367721+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:39.291069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024788879999999998,"stat_sum":{"num_bytes":41473203,"num_objects":54,"num_object_clones":18,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":27,"num_read":2983,"num_read_kb":19755,"num_write":329,"num_write_kb":15788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":83,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.a","version":"123'650","reported_seq":16378,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.377300+0000","last_change":"2024-09-21T14:00:29.377300+0000","last_active":"2024-09-21T14:00:29.377300+0000","last_peered":"2024-09-21T14:00:29.377300+0000","last_clean":"2024-09-21T14:00:29.377300+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:00:29.377300+0000","last_undegraded":"2024-09-21T14:00:29.377300+0000","last_fullsized":"2024-09-21T14:00:29.377300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000400071,"stat_sum":{"num_bytes":34774022,"num_objects":74,"num_object_clones":14,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":38,"num_read":18948,"num_read_kb":32869,"num_write":769,"num_write_kb":20225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.b","version":"122'510","reported_seq":3472,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.371625+0000","last_change":"2024-09-21T14:00:29.371881+0000","last_active":"2024-09-21T14:00:29.371625+0000","last_peered":"2024-09-21T14:00:29.371625+0000","last_clean":"2024-09-21T14:00:29.371625+0000","last_became_active":"2024-09-21T14:00:24.183369+0000","last_became_peered":"2024-09-21T14:00:24.183369+0000","last_unstale":"2024-09-21T14:00:29.371625+0000","last_undegraded":"2024-09-21T14:00:29.371625+0000","last_fullsized":"2024-09-21T14:00:29.371625+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:52:40.055774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094115699999999997,"stat_sum":{"num_bytes":29241468,"num_objects":62,"num_object_clones":19,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":32,"num_read":3738,"num_read_kb":20375,"num_write":578,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":23558154,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.c","version":"123'499","reported_seq":3471,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.464425+0000","last_change":"2024-09-21T14:00:29.373213+0000","last_active":"2024-09-21T14:00:29.464425+0000","last_peered":"2024-09-21T14:00:29.464425+0000","last_clean":"2024-09-21T14:00:29.464425+0000","last_became_active":"2024-09-21T13:58:21.664427+0000","last_became_peered":"2024-09-21T13:58:21.664427+0000","last_unstale":"2024-09-21T14:00:29.464425+0000","last_undegraded":"2024-09-21T14:00:29.464425+0000","last_fullsized":"2024-09-21T14:00:29.464425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:51.275392+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0072496899999999996,"stat_sum":{"num_bytes":54752072,"num_objects":64,"num_object_clones":20,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":38,"num_read":3910,"num_read_kb":19354,"num_write":642,"num_write_kb":12188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.d","version":"127'403","reported_seq":4808,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.550174+0000","last_change":"2024-09-21T14:00:33.392002+0000","last_active":"2024-09-21T14:00:33.550174+0000","last_peered":"2024-09-21T14:00:33.550174+0000","last_clean":"2024-09-21T14:00:33.550174+0000","last_became_active":"2024-09-21T14:00:04.181840+0000","last_became_peered":"2024-09-21T14:00:04.181840+0000","last_unstale":"2024-09-21T14:00:33.550174+0000","last_undegraded":"2024-09-21T14:00:33.550174+0000","last_fullsized":"2024-09-21T14:00:33.550174+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:15:37.792573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026013410000000001,"stat_sum":{"num_bytes":24323451,"num_objects":52,"num_object_clones":16,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":31,"num_read":4817,"num_read_kb":30845,"num_write":593,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]},{"pgid":"3.e","version":"127'485","reported_seq":7622,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.544662+0000","last_change":"2024-09-21T14:00:33.392330+0000","last_active":"2024-09-21T14:00:33.544662+0000","last_peered":"2024-09-21T14:00:33.544662+0000","last_clean":"2024-09-21T14:00:33.544662+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:00:33.544662+0000","last_undegraded":"2024-09-21T14:00:33.544662+0000","last_fullsized":"2024-09-21T14:00:33.544662+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024640360000000002,"stat_sum":{"num_bytes":35708259,"num_objects":64,"num_object_clones":21,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":32,"num_read":7887,"num_read_kb":28897,"num_write":534,"num_write_kb":11934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]},{"pgid":"3.f","version":"126'589","reported_seq":5265,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.395725+0000","last_change":"2024-09-21T14:00:33.396036+0000","last_active":"2024-09-21T14:00:33.395725+0000","last_peered":"2024-09-21T14:00:33.395725+0000","last_clean":"2024-09-21T14:00:33.395725+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:00:33.395725+0000","last_undegraded":"2024-09-21T14:00:33.395725+0000","last_fullsized":"2024-09-21T14:00:33.395725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00571786,"stat_sum":{"num_bytes":43492361,"num_objects":72,"num_object_clones":26,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":36,"num_read":6505,"num_read_kb":26621,"num_write":714,"num_write_kb":15591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]},{"pgid":"3.10","version":"122'537","reported_seq":4387,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.377442+0000","last_change":"2024-09-21T14:00:29.378448+0000","last_active":"2024-09-21T14:00:29.377442+0000","last_peered":"2024-09-21T14:00:29.377442+0000","last_clean":"2024-09-21T14:00:29.377442+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:00:29.377442+0000","last_undegraded":"2024-09-21T14:00:29.377442+0000","last_fullsized":"2024-09-21T14:00:29.377442+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286534,"stat_sum":{"num_bytes":35643990,"num_objects":79,"num_object_clones":24,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":40,"num_read":4202,"num_read_kb":32280,"num_write":587,"num_write_kb":19125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.11","version":"126'278","reported_seq":3865,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.391068+0000","last_change":"2024-09-21T14:00:33.391386+0000","last_active":"2024-09-21T14:00:33.391068+0000","last_peered":"2024-09-21T14:00:33.391068+0000","last_clean":"2024-09-21T14:00:33.391068+0000","last_became_active":"2024-09-21T14:00:04.181801+0000","last_became_peered":"2024-09-21T14:00:04.181801+0000","last_unstale":"2024-09-21T14:00:33.391068+0000","last_undegraded":"2024-09-21T14:00:33.391068+0000","last_fullsized":"2024-09-21T14:00:33.391068+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:34:10.099543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018635259999999999,"stat_sum":{"num_bytes":33385779,"num_objects":60,"num_object_clones":18,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":32,"num_read":3515,"num_read_kb":29157,"num_write":261,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]},{"pgid":"3.12","version":"122'899","reported_seq":4421,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-21T14:00:29.379283+0000","last_change":"2024-09-21T14:00:29.379922+0000","last_active":"2024-09-21T14:00:29.379283+0000","last_peered":"2024-09-21T14:00:29.379283+0000","last_clean":"2024-09-21T14:00:29.379283+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:00:29.379283+0000","last_undegraded":"2024-09-21T14:00:29.379283+0000","last_fullsized":"2024-09-21T14:00:29.379283+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075321299999999997,"stat_sum":{"num_bytes":37594891,"num_objects":54,"num_object_clones":14,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":28,"num_read":7979,"num_read_kb":28141,"num_write":1430,"num_write_kb":24335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"25","length":"4"}]},{"pgid":"3.13","version":"126'360","reported_seq":1331,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-21T14:00:33.389394+0000","last_change":"2024-09-21T14:00:33.389788+0000","last_active":"2024-09-21T14:00:33.389394+0000","last_peered":"2024-09-21T14:00:33.389394+0000","last_clean":"2024-09-21T14:00:33.389394+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:00:33.389394+0000","last_undegraded":"2024-09-21T14:00:33.389394+0000","last_fullsized":"2024-09-21T14:00:33.389394+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054613199999999995,"stat_sum":{"num_bytes":24522574,"num_objects":45,"num_object_clones":13,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":24,"num_read":1875,"num_read_kb":7659,"num_write":317,"num_write_kb":8469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"21","length":"5"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1199021156,"num_objects":2236,"num_object_clones":667,"num_object_copies":4472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2236,"num_whiteouts":1156,"num_read":274707,"num_read_kb":922691,"num_write":23124,"num_write_kb":496803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4292,"num_bytes_recovered":401198512,"num_keys_recovered":461,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":727863296,"data_stored":845093655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":18426,"ondisk_log_size":18426,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925832,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":183164,"kb_used_data":142092,"kb_used_omap":14,"kb_used_meta":41009,"kb_avail":94188676,"statfs":{"total":96636764160,"available":96449204224,"internally_reserved":0,"allocated":145502208,"data_stored":167840654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":41994118},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121764,"kb_used_data":54496,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94250076,"statfs":{"total":96636764160,"available":96512077824,"internally_reserved":0,"allocated":55803904,"data_stored":64197138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68811207},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.443,"5min":0.314,"15min":0.314},"max":{"1min":1.234,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.88800000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68200000000000005,"15min":0.67300000000000004},"min":{"1min":0.48999999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.96799999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.163,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.2589999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.89100000000000001,"15min":0.90500000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.427,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.65800000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.89900000000000002,"15min":0.90600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.573,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81000000000000005,"15min":0.81399999999999995},"min":{"1min":0.53300000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.367,"5min":1.367,"15min":1.367},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86799999999999999,"15min":0.88},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.105,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.98699999999999999,"15min":1.008},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7529999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2350000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.92400000000000004,"15min":0.93300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5109999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95999999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.86399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155784,"kb_used_data":124652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94216056,"statfs":{"total":96636764160,"available":96477241344,"internally_reserved":0,"allocated":127643648,"data_stored":146526936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.29599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1160000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72199999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97399999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80000000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82199999999999995,"15min":0.83399999999999996},"min":{"1min":0.40699999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.97499999999999998,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.441,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.98999999999999999,"5min":1.351,"15min":1.351},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.84599999999999997},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.25,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.45700000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2829999999999999,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.84299999999999997}]},{"osd":3,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.82299999999999995,"15min":0.82399999999999995},"min":{"1min":0.497,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1639999999999999,"5min":1.579,"15min":1.579},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.1739999999999999,"15min":1.218},"min":{"1min":0.51000000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.357,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2490000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.873,"15min":0.878},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.0640000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.91000000000000003,"15min":0.91400000000000003},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":1.512,"5min":1.627,"15min":1.627},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.90400000000000003,"15min":0.90800000000000003},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.296,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215160,"kb_used_data":157804,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94156680,"statfs":{"total":96636764160,"available":96416440320,"internally_reserved":0,"allocated":161591296,"data_stored":187917044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.39400000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.996,"5min":1.274,"15min":1.274},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.878,"15min":0.90400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.9259999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":2.2879999999999998,"15min":2.5579999999999998},"min":{"1min":0.42699999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.004,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.276},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.48399999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1519999999999999,"5min":1.528,"15min":1.528},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.85699999999999998,"15min":0.86699999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.1200000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.85299999999999998,"15min":0.87},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":1.0529999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.73099999999999998}]},{"osd":3,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.224,"15min":1.292},"min":{"1min":0.54300000000000004,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.0600000000000001,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":2.6869999999999998,"15min":3.0049999999999999},"min":{"1min":0.53000000000000003,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.083,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.878,"15min":0.89300000000000002},"min":{"1min":0.39700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.3009999999999999,"5min":1.476,"15min":1.476},"last":0.997},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.99199999999999999,"15min":1.004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.234,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.03}]},{"osd":6,"last update":"Sat Sep 21 14:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":2.262,"15min":2.5019999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.276,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.876},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.94399999999999995,"15min":0.95999999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2270000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":172296,"kb_used_data":119032,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94199544,"statfs":{"total":96636764160,"available":96460333056,"internally_reserved":0,"allocated":121888768,"data_stored":141592525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":54524360},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46999999999999997,"15min":0.47399999999999998},"min":{"1min":0.19500000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.83299999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.96199999999999997,"5min":1.873,"15min":1.873},"last":0.5}]},{"osd":1,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":0.88900000000000001,"15min":0.79100000000000004},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":21.995000000000001,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.47099999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0389999999999999,"5min":1.157,"15min":1.157},"last":0.42099999999999999},{"interface":"front","average":{"1min":1.587,"5min":0.998,"15min":0.90000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":22.109000000000002,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":1.6499999999999999,"5min":1.014,"15min":0.90800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":22.210999999999999,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.92900000000000005,"15min":0.93600000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":4.4340000000000002,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.61299999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.96499999999999997,"15min":1.0029999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.2230000000000001,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.88800000000000001,"15min":0.90800000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2909999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.76600000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.1950000000000001,"15min":1.1020000000000001},"min":{"1min":0.42099999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":22.157,"5min":22.157,"15min":22.157},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.90500000000000003,"15min":0.92300000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.161,"5min":2.641,"15min":2.641},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36656,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335184,"statfs":{"total":96636764160,"available":96599228416,"internally_reserved":0,"allocated":1470464,"data_stored":691717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.57899999999999996,"15min":0.58999999999999997},"min":{"1min":0.23499999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.79100000000000004,"5min":1.133,"15min":1.133},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.67900000000000005,"15min":0.69699999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.95299999999999996,"5min":2.355,"15min":2.355},"last":0.33300000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.624,"15min":0.61899999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":1.083},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.36399999999999999,"5min":0.315,"15min":0.315},"max":{"1min":1.0629999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.66700000000000004}]},{"osd":3,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":1.3620000000000001,"15min":1.468},"min":{"1min":0.32400000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.371,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.312},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.4330000000000001,"15min":1.5389999999999999},"min":{"1min":0.312,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.615,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.90900000000000003,"15min":0.92700000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.409,"5min":1.609,"15min":1.609},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":1.208,"15min":1.2729999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.5600000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.49199999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86499999999999999,"15min":0.87},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.4370000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.91100000000000003,"15min":0.92700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":1.0189999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:00:09 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.96999999999999997},"min":{"1min":0.51200000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.645,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.472,"5min":1.675,"15min":1.675},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45660,"kb_used_data":10444,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94326180,"statfs":{"total":96636764160,"available":96590008320,"internally_reserved":0,"allocated":10694656,"data_stored":11587393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65700000000000003,"15min":0.66500000000000004},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.032,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.314}]},{"osd":2,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58799999999999997,"15min":0.58999999999999997},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0609999999999999,"5min":1.157,"15min":1.157},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.64400000000000002,"15min":0.63200000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.41699999999999998}]},{"osd":3,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.65900000000000003,"15min":0.65100000000000002},"min":{"1min":0.27600000000000002,"5min":0.221,"15min":0.221},"max":{"1min":2.5939999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":1.2829999999999999,"15min":1.397},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81499999999999995,"5min":13.083,"15min":13.083},"last":0.37}]},{"osd":4,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.51600000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.0409999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84599999999999997,"15min":0.84199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.84399999999999997,"15min":0.85399999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1220000000000001,"5min":1.732,"15min":1.732},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.82299999999999995},"min":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.468,"15min":1.468},"last":0.54500000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.873,"15min":0.88500000000000001},"min":{"1min":0.53800000000000003,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1299999999999999,"5min":1.552,"15min":1.552},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.874,"5min":0.99399999999999999,"15min":1.014},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.2210000000000001,"5min":2.48,"15min":2.48},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187292,"kb_used_data":120024,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94184548,"statfs":{"total":96636764160,"available":96444977152,"internally_reserved":0,"allocated":122904576,"data_stored":136331865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.22,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.149,"5min":1.206,"15min":1.206},"last":0.38}]},{"osd":2,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.77200000000000002,"15min":0.80200000000000005},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.018,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.97399999999999998,"15min":1.034},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.1020000000000001,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.40999999999999998}]},{"osd":3,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":1.05,"15min":1.1279999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.95699999999999996,"5min":11.84,"15min":11.84},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73999999999999999,"15min":0.754},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0740000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.33200000000000002}]},{"osd":4,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.89800000000000002,"15min":0.91500000000000004},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.1830000000000001,"5min":1.647,"15min":1.647},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.871,"15min":0.88800000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.129,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.85999999999999999},"min":{"1min":0.55800000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0600000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.054,"15min":1.0800000000000001},"min":{"1min":0.54400000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.643,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Sep 21 14:00:07 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0740000000000001,"15min":1.1060000000000001},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5960000000000001,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.91200000000000003,"15min":0.92900000000000005},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.2549999999999999,"5min":1.409,"15min":1.409},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":120082432,"data_stored":133712513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9150464,"data_stored":10830545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10792960,"data_stored":14415623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":120197120,"data_stored":140582425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":158105600,"data_stored":185268284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":124751872,"data_stored":143217414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":54222848,"data_stored":63356184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":130560000,"data_stored":153710667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:00:34.929 INFO:tasks.thrashosds.thrasher:Setting 3.1e to [5, 6] 2024-09-21T14:00:34.929 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1e', '5', '6'] 2024-09-21T14:00:34.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1e 5 6 2024-09-21T14:00:34.981 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.14395544200001, 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:34.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T14:00:34.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.003932002, 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T14:00:34.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.975672997, 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:34.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T14:00:34.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:34.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.07856445199999, 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:34.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:35.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T14:00:35.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T14:00:35.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.07850298300001, 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T14:00:35.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069439008, 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T14:00:35.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069381248, 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T14:00:35.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T14:00:35.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T14:00:35.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069362656, 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.021 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:35.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.06935031800001, 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.026 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.030 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069328582, 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T14:00:35.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069305399, 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.039 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.06928497, 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:35.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T14:00:35.043 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069270172, 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T14:00:35.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.049 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069245588, 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T14:00:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T14:00:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069228892, 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T14:00:35.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:35.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T14:00:35.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:35.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.069206655, 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T14:00:35.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T14:00:35.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.15091835200001, 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:35.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T14:00:35.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:35.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T14:00:35.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.080 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 120.98139980400001, 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:35.081 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T14:00:35.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T14:00:35.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T14:00:35.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T14:00:35.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 120.61816121, 2024-09-21T14:00:35.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:35.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T14:00:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:35.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T14:00:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T14:00:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T14:00:35.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T14:00:35.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:35.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T14:00:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T14:00:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:35.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T14:00:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T14:00:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T14:00:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T14:00:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.347755616999997, 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T14:00:35.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T14:00:35.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T14:00:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T14:00:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T14:00:35.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T14:00:35.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:35.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T14:00:35.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.123 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.123 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:35.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:35.126 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:35.122+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:35.225 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:35.222+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:35.283 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:35.284 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:35.284 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:35.284 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:35.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:35.326 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:35.323+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:35.392 INFO:teuthology.orchestra.run.smithi079.stderr:set 3.1e pg_upmap mapping to [5,6] 2024-09-21T14:00:35.392 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T14:00:35.426 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:35.422+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:35.472 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:35.472 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:35.472 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:35.473 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:35.473 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:35.487 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:35.532 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:35.530+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:35.602 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:35.602 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07963232500001, 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:35.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:35.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079520702, 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07950087899999, 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:35.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:35.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.0794767, 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:35.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:35.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07945259500001, 2024-09-21T14:00:35.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:35.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.628 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07943408600001, 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:35.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079424344, 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:35.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079399485, 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:35.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.643 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07937080799999, 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:35.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:35.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07935199000001, 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:35.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:35.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079331319, 2024-09-21T14:00:35.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079310248, 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:35.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:35.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079274396, 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:35.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:35.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079242174, 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:35.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:35.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:35.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:35.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07920653399999, 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:35.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:35.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079172056, 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:35.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07911749599999, 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.688 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:35.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:35.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07907833100001, 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:35.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:35.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:35.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.079039595, 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:35.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.07901484200001, 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.703 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:35.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:35.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:35.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:35.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:35.709 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:35.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:35.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:35.706+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:35.811 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:35.806+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:35.882 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:35.882 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:35.883 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:35.883 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:35.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:35.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:35.938+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:36.014 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:36.010+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:36.064 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:36.065 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:36.065 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:36.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:36.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:36.120 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:36.118+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:36.215 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:36.211+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.837679319, 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:36.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.797592481, 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:36.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:36.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 113.736279225, 2024-09-21T14:00:36.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:36.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:36.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.271820286999997, 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:36.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.271773007999997, 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:36.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.271733505999997, 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:36.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:36.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:36.269 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.271694447000002, 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:36.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:36.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:36.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743330788999998, 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743303099000002, 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:36.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743280613000003, 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:36.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:36.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743233500000002, 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:36.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:36.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.292 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:36.293 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743212853999999, 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:36.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:36.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:36.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:36.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743188562999997, 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.304 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:36.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:36.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:36.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:36.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743168060000002, 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.313 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:36.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743145746000003, 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:36.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743127561000001, 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:36.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743109081, 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:36.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.331 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743063413000002, 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:36.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743038691999999, 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.340 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.743019578000002, 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.341 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:36.345 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:36.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:36.347 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:36.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:36.348 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:36.348 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:36.348 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:36.349 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:36.349 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:36.349 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:36.350 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:36.350 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:36.342+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:36.353 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:36.353 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:36.372 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:36.372 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:36.390 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:36.390 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:36.448 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:36.443+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:36.484 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:36.484 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:36.498 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:36.586 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:36.583+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:36.650 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:36.647+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:36.664 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:36.665 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:36.679 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:36.766 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:36.763+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:36.853 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:36.847+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:36.862 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:36.954 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:36.947+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:37.026 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.027 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:37.083 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:37.079+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:37.156 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:37.154+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.203 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:37.267 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:37.263+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:37.338 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.338 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:37.399 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:37.395+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:37.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:00:37.476 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:37.474+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:37.537 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.537 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:37.558 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:37.554+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:37.659 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:37.654+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:37.688 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.688 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:37.759 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:37.754+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:37.860 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:37.858+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:37.961 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:37.958+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:37.964 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:37.964 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:37.978 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:38.062 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:38.058+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:38.102 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:38.102 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:38.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:38.163 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:38.158+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:38.241 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:38.241 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:38.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:38.263 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:38.259+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:38.364 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:38.359+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:38.386 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:38.386 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:38.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:38.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:38.424 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:00:38.465 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:38.459+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:38.536 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:38.536 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:38.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:38.577 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:38.577 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:38.578 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:38.574+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:38.594 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:38.594 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:38.610 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:38.611 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:38.627 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:38.627 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:38.647 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:38.647 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:38.666 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:38.662+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:38.667 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:16294 3.6 3:60e3d35b:::rbd_data.1185a7c518d0.00000000000001a3:head [stat,delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 116.06474341099999, 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.709255619, 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 16294 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606053+0000", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606051+0000", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606059+0000", 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7669999999999992e-06 2024-09-21T14:00:38.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606076+0000", 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6869999999999999e-05 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606083+0000", 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0319999999999998e-06 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606127+0000", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3917e-05 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.606135+0000", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3849999999999996e-06 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313383+0000", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70724869700000004 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.313603+0000", 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021959200000000001 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.315308+0000", 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001705374 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126374 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 139264~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 102.133197671, 2024-09-21T14:00:38.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051883469000000002, 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126374 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537598+0000", 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537600+0000", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.928e-06 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537606+0000", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537610+0000", 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3100000000000002e-06 2024-09-21T14:00:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589181+0000", 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051570947999999998 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589253+0000", 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1888e-05 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589482+0000", 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022909499999999999 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126375 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 186368~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 102.133182303, 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052140767999999997, 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126375 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537614+0000", 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537613+0000", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537615+0000", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.883e-06 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537621+0000", 2024-09-21T14:00:38.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6099999999999997e-06 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537625+0000", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3250000000000001e-06 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589526+0000", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051900689999999999 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589608+0000", 2024-09-21T14:00:38.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2303000000000001e-05 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589755+0000", 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014629899999999999 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126376 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 206848~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 102.133167153, 2024-09-21T14:00:38.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052321403000000002, 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126376 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537629+0000", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537631+0000", 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.885e-06 2024-09-21T14:00:38.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537636+0000", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537641+0000", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4859999999999999e-06 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589787+0000", 2024-09-21T14:00:38.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052146603 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589859+0000", 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1361999999999999e-05 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589950+0000", 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1656000000000005e-05 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:126377 3.12 3:4a506538:::rbd_data.11852774f807.0000000000000019:d [read 253952~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e50)", 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 102.13313164, 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052564323000000003, 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 126377 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537664+0000", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537666+0000", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.708e-06 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537670+0000", 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0180000000000003e-06 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.537672+0000", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6120000000000001e-06 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.589967+0000", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052294144000000001 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590005+0000", 2024-09-21T14:00:38.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8633000000000001e-05 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:56.590229+0000", 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223546 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:141005 3.1f 3:fbe4e7fd:::rbd_data.1185dbcc99d3.0000000000000008:11 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:38.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 95.787424634999994, 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051797867999999997, 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 141005 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883371+0000", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883373+0000", 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2910000000000002e-06 2024-09-21T14:00:38.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883381+0000", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.883386+0000", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0010000000000001e-06 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934854+0000", 2024-09-21T14:00:38.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051467947 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.934932+0000", 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7459999999999994e-05 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:02.935169+0000", 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023782 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.699 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175471 3.17 3:ef6d180f:::rbd_data.11855aa4020c.0000000000000070:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.117401994999994, 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.062004912000000002, 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175471 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:38.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553394+0000", 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553392+0000", 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553405+0000", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3359e-05 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553427+0000", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2311999999999999e-05 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553439+0000", 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1056999999999999e-05 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553562+0000", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012383500000000001 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.553816+0000", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025313499999999998 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.566930+0000", 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013114071 2024-09-21T14:00:38.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615203+0000", 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048273407999999997 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615286+0000", 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2930999999999996e-05 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:38.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615354+0000", 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8522999999999994e-05 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615399+0000", 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4586000000000003e-05 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:175472 3.17 3:e85b8e94:::rbd_data.11855aa4020c.0000000000000073:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 83.116074284999996, 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.061247465000000001, 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 175472 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554722+0000", 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554721+0000", 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554728+0000", 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1749999999999999e-06 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554743+0000", 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5014000000000001e-05 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.554751+0000", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0180000000000001e-06 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612330+0000", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.057579114000000001 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.612537+0000", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000207276 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.613215+0000", 2024-09-21T14:00:38.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00067735699999999996 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615428+0000", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022130930000000002 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615871+0000", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044277200000000002 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615931+0000", 2024-09-21T14:00:38.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0136999999999997e-05 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:15.615969+0000", 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8636000000000001e-05 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194225 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 155648~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271893413999997, 2024-09-21T14:00:38.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095458702, 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194225 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398903+0000", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398900+0000", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398913+0000", 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3393e-05 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398939+0000", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5701999999999999e-05 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398958+0000", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9143e-05 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399393+0000", 2024-09-21T14:00:38.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043441999999999998 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399421+0000", 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8313000000000001e-05 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.493917+0000", 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.094495529 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494136+0000", 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021943399999999999 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494361+0000", 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225398 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194226 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 499712~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271821889999998, 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0959807589999999, 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194226 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398974+0000", 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398973+0000", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.398978+0000", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7230000000000004e-06 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399004+0000", 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5913000000000001e-05 2024-09-21T14:00:38.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399015+0000", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0869e-05 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399511+0000", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049627500000000001 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399545+0000", 2024-09-21T14:00:38.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3399999999999999e-05 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494664+0000", 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0951194070000001 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494769+0000", 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104806 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.494955+0000", 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018614200000000001 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194227 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 843776~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271726368000003, 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096505544, 2024-09-21T14:00:38.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194227 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399070+0000", 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399069+0000", 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399076+0000", 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1829999999999997e-06 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399106+0000", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0056000000000002e-05 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399117+0000", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1107000000000001e-05 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399684+0000", 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056671300000000005 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399709+0000", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4929000000000001e-05 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495036+0000", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095327486 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495228+0000", 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019193199999999999 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495575+0000", 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034717500000000002 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194228 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1179648~24576] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271670270000001, 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096785039, 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194228 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399126+0000", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399125+0000", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399129+0000", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2769999999999999e-06 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399144+0000", 2024-09-21T14:00:38.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4316e-05 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399155+0000", 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0723000000000001e-05 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399810+0000", 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065564499999999995 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399821+0000", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0709e-05 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495627+0000", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.095806501 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495733+0000", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105191 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.495911+0000", 2024-09-21T14:00:38.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017831699999999999 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194229 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1523712~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271634740000003, 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0972283190000001, 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194229 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399161+0000", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399164+0000", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6660000000000001e-06 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399173+0000", 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7029999999999995e-06 2024-09-21T14:00:38.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399180+0000", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.153e-06 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399913+0000", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000732433 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399938+0000", 2024-09-21T14:00:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5279e-05 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496084+0000", 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096145806 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496228+0000", 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014464600000000001 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496390+0000", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016125300000000001 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:194230 3.1b 3:d85ae2ef:::rbd_data.1185c72d2edc.000000000000001a:1f [read 1859584~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.271609621000003, 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0974695809999999, 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 194230 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399186+0000", 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399190+0000", 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7100000000000001e-06 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399201+0000", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.096e-05 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.399210+0000", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400000+0000", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078962800000000001 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:43.400009+0000", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2159999999999995e-06 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496420+0000", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0964110419999999 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496512+0000", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1990999999999994e-05 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:44.496656+0000", 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014384099999999999 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:207984 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 10452992~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.975103822000001, 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051824888999999999, 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.742 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 207984 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695692+0000", 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695538+0000", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9998455 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695696+0000", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015823700000000001 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695706+0000", 2024-09-21T14:00:38.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.747e-06 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.695713+0000", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7449999999999998e-06 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747349+0000", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051636434000000002 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747424+0000", 2024-09-21T14:00:38.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5383000000000007e-05 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.747517+0000", 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2769000000000006e-05 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208073 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8699904~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.973820840000002, 2024-09-21T14:00:38.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051993365999999999, 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208073 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696975+0000", 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696977+0000", 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0999999999999998e-06 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696983+0000", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8950000000000003e-06 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.696987+0000", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1579999999999998e-06 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748768+0000", 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051780964999999998 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748865+0000", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7091999999999998e-05 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748969+0000", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103516 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208074 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 8744960~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:38.750 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.973774493999997, 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052150335999999999, 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208074 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697022+0000", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697021+0000", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697024+0000", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4000000000000001e-06 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697032+0000", 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.926e-06 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.697038+0000", 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.748992+0000", 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051953724 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749061+0000", 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9778999999999997e-05 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.749172+0000", 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110513 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.754 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:208097 3.1 3:834a41ce:::rbd_data.118551b8ee3.0000000000000009:21 [read 9736192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.966656972000003, 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.060659679000000001, 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 208097 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704139+0000", 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704141+0000", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4880000000000001e-06 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704148+0000", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3060000000000003e-06 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.704153+0000", 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1420000000000001e-06 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753446+0000", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292914 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.753521+0000", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5218999999999999e-05 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.764799+0000", 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011277986 2024-09-21T14:00:38.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224261 3.17 3:ef2aedab:::rbd_data.1185ddc9253f.000000000000000b:head [set-alloc-hint object_size 8388608 write_size 8388608,write 3910007~11512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.330151726, 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.98341140100000002, 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224261 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340644+0000", 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340643+0000", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340656+0000", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2653999999999999e-05 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340667+0000", 2024-09-21T14:00:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1542000000000001e-05 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340673+0000", 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7259999999999999e-06 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340731+0000", 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7942000000000002e-05 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:20.340745+0000", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320390+0000", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.97964514800000002 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320654+0000", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000263823 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:38.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.320983+0000", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000328771 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323508+0000", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025252819999999998 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323545+0000", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7398999999999999e-05 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:38.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.323889+0000", 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034357099999999998 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.324056+0000", 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016691899999999999 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:224418 3.6 3:62a11d6e:::rbd_data.1185ddc9253f.0000000000000000:head [stat,truncate 7471104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:38.765 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.977897767000002, 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49754111600000001, 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 224418 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692898+0000", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692896+0000", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692904+0000", 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:38.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692921+0000", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7136e-05 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692933+0000", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1552999999999999e-05 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.692994+0000", 2024-09-21T14:00:38.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1197000000000004e-05 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:21.693006+0000", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2371000000000001e-05 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185600+0000", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.49259357599999998 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.185989+0000", 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038928500000000001 2024-09-21T14:00:38.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.186369+0000", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037962400000000001 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.187807+0000", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014381229999999999 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190326+0000", 2024-09-21T14:00:38.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025187009999999999 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190385+0000", 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9001e-05 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T14:00:22.190439+0000", 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4894e-05 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:38.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:38.772 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:38.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:38.773 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:38.774 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:38.774 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:38.775 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:38.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:38.770+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:38.874 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:38.870+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:38.941 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:38.941 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:38.941 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:38.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:38.974 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:38.971+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:39.076 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:39.074+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:39.126 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:39.126 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:39.127 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:39.127 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:39.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:39.177 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:39.171+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:39.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:39.274+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:39.311 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.472564734, 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.317 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.33254129400001, 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T14:00:39.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:39.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T14:00:39.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T14:00:39.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T14:00:39.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.30428228900001, 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T14:00:39.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.407173744, 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.333 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.407112275, 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.3980483, 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T14:00:39.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39799054, 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:39.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T14:00:39.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T14:00:39.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:39.346 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39797194800001, 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T14:00:39.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39795961, 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T14:00:39.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39793787399999, 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T14:00:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.397914691, 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:39.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.363 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39789426199999, 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:39.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.397879464, 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T14:00:39.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39785488, 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.372 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.39783818399999, 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:39.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.397815947, 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.479527644, 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T14:00:39.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T14:00:39.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T14:00:39.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.310009096, 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T14:00:39.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T14:00:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.395 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 124.94677050200001, 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:39.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T14:00:39.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T14:00:39.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T14:00:39.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T14:00:39.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.676364909, 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.401 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:39.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.406 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:39.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:39.408 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:39.407+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:39.508 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:39.503+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:39.585 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:39.585 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:39.585 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:39.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:39.648 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:39.646+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:39.711 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:39.706+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:39.726 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:39.727 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:39.727 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:39.727 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:39.727 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:39.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:39.832 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:39.830+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:39.912 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:39.910+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:39.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396486405, 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396374782, 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:39.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:39.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.928 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39635495900001, 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:39.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:39.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39633078, 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:39.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:39.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39630667500001, 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39628816600001, 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:39.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:39.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396278424, 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:39.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.951 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39625356499999, 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:39.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.956 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39622488800001, 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:39.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39620607000001, 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:39.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:39.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396185399, 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:39.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396164328, 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:39.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:39.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396128476, 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:39.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:39.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396096254, 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:39.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39606061400001, 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:39.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:39.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:39.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.396026136, 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39597157599999, 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.994 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:39.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:39.998 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.395932411, 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:39.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.395893675, 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:40.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.39586892200001, 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:40.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:40.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.014 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:40.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:40.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:40.010+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:40.116 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:40.111+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:40.183 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:40.183 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:40.183 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:40.183 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:40.198 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:40.244 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:40.242+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:40.317 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:40.314+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:40.320 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:40.321 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:40.321 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:40.321 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:40.321 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:40.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:40.422 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:40.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:40.425 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-21T14:00:40.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-21T14:00:40.432 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:40.430+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:40.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:00:40.524 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 118.122119732, 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:40.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:40.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:40.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:40.531 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 118.08203289399999, 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:40.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 118.020719638, 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:40.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:40.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:40.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.556260700000003, 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:40.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:40.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.556213421000002, 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:40.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:40.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.556173919000003, 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.550 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:40.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:40.554 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.55613486, 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:40.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:40.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027771201999997, 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:40.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:40.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027743512000001, 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027721026000002, 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:40.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027673913000001, 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:40.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:40.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027653266999998, 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:40.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:40.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027628976000003, 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:40.585 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027608473000001, 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:40.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:40.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:40.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027586159000002, 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027567974, 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:40.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:40.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:40.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027549493999999, 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:40.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027503826, 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:40.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027479104999998, 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:40.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:40.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.027459991000001, 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:40.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:40.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:40.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:40.616 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:40.617 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:40.522+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:40.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:40.619 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-21T14:00:40.660 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:40.658+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:40.720 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:40.718+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:40.753 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:40.753 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:40.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:40.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:40.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-21T14:00:40.860 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:40.858+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:40.888 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:40.888 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:40.889 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:40.889 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:40.889 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:40.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:40.921 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:40.918+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:40.924 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:40.924 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:40.940 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:40.941 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:40.957 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:40.957 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:40.972 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:40.973 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:40.992 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:40.992 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:41.010 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:41.010 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:41.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:41.018+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:41.022 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.023 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-21T14:00:41.030 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:41.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:41.049 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:41.049 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:41.124 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:41.119+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:41.158 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.158 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:41.188 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-21T14:00:41.236 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:41.234+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:41.325 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:41.319+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:41.338 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.338 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.340 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-21T14:00:41.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:41.432 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:41.430+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:41.454 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:00:41.528 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:41.523+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:41.528 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.528 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:41.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-21T14:00:41.628 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:41.626+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:41.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-21T14:00:41.710 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.710 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:41.770 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:41.767+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:41.830 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:41.827+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:41.849 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:41.849 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:41.863 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:41.931 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:41.926+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:42.031 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.031 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.031 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:42.026+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:42.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:42.132 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:42.127+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:42.161 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.161 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:42.262 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:42.259+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:42.334 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:42.327+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:42.347 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.347 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:42.446 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:42.443+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:42.529 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.529 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.536 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:42.531+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:42.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:42.637 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:42.631+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:42.678 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.678 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.692 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:42.738 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:42.735+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:42.814 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.814 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:42.872 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:42.870+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:42.940 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:42.939+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:42.943 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:42.943 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:42.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:43.041 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:43.039+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:43.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:43.123 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:43.123 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:43.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:43.141 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:43.135+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:43.242 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:43.238+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:43.250 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:43.250 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:43.266 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:43.266 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:43.282 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:43.298 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:43.298 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:43.299 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:43.299 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:43.299 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:43.299 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:43.299 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:43.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:43.318 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:43.319 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:43.339 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:43.339 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:43.343 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:43.338+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:43.359 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:43.379 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:43.380 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:962 3.0 3:0542bee9:::rbd_data.1185e8851f1.0000000000000064:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 134.59879086800001, 2024-09-21T14:00:43.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019778469999999999, 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 962 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835764+0000", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835763+0000", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835775+0000", 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2329e-05 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835786+0000", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0712e-05 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835791+0000", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4960000000000004e-06 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835826+0000", 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4854999999999997e-05 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.835910+0000", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3682000000000003e-05 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.839059+0000", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031489780000000002 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855444+0000", 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016385429999999999 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855478+0000", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3558e-05 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855515+0000", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7044e-05 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.855542+0000", 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7398000000000001e-05 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:1013 3.0 3:07882bf1:::rbd_data.1185e8851f1.0000000000000049:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 134.45876742799999, 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.059015592999999998, 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1013 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975787+0000", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975786+0000", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975792+0000", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5899999999999998e-06 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975807+0000", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5345999999999998e-05 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975815+0000", 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8960000000000003e-06 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.975917+0000", 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010221900000000001 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.976141+0000", 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022365800000000001 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:28.987839+0000", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011698363999999999 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034665+0000", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.046826246000000002 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034681+0000", 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5877000000000001e-05 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034746+0000", 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4369000000000007e-05 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034803+0000", 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7012000000000002e-05 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.448 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4485.0:1013 3.0 e29/23 ondisk, result = 0)", 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 134.43050842299999, 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030623829000000002, 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004046+0000", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004045+0000", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004050+0000", 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6739999999999996e-06 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004063+0000", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3692999999999999e-05 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.004072+0000", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9730000000000003e-06 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034643+0000", 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030570736000000001 2024-09-21T14:00:43.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034656+0000", 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3183999999999999e-05 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:29.034670+0000", 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3515e-05 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3301 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3866624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.53339987800001, 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087838050000000004, 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3301 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901155+0000", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901154+0000", 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:43.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901159+0000", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7870000000000001e-06 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901171+0000", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2702e-05 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901181+0000", 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8130000000000007e-06 2024-09-21T14:00:43.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909131+0000", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0079503549999999992 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909229+0000", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7423999999999994e-05 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909938+0000", 2024-09-21T14:00:43.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00070958600000000001 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3302 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3899392~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.53333840900001, 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082902670000000005, 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.457 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3302 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901216+0000", 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901215+0000", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901220+0000", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7419999999999997e-06 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901233+0000", 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.261e-05 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.901242+0000", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8099999999999992e-06 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909346+0000", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081032840000000005 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909440+0000", 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4621000000000001e-05 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.909506+0000", 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6051999999999997e-05 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3482 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 294912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52427443400001, 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080919340000000003, 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3482 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910280+0000", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910307+0000", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7430999999999999e-05 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910315+0000", 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000002e-06 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910332+0000", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7331999999999999e-05 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918153+0000", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078206779999999993 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918248+0000", 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5027999999999999e-05 2024-09-21T14:00:43.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918372+0000", 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012401099999999999 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3483 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 327680~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.524216674, 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082843420000000001, 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3483 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910338+0000", 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910337+0000", 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910340+0000", 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0249999999999998e-06 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910347+0000", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5050000000000004e-06 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910353+0000", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3219999999999998e-06 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918429+0000", 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080761489999999995 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918514+0000", 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4486000000000004e-05 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918622+0000", 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010836399999999999 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3484 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1769472~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.469 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.524198082, 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085172370000000004, 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3484 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910356+0000", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910358+0000", 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.584e-06 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910362+0000", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2799999999999997e-06 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910366+0000", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2540000000000003e-06 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918666+0000", 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082993609999999999 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918750+0000", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3911000000000003e-05 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918874+0000", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012409899999999999 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3485 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1703936~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52418574399999, 2024-09-21T14:00:43.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086809799999999996, 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3485 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910369+0000", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910370+0000", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910379+0000", 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5859999999999994e-06 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910388+0000", 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1990000000000006e-06 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918908+0000", 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085201189999999996 2024-09-21T14:00:43.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.918980+0000", 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2668000000000003e-05 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919050+0000", 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9288999999999993e-05 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3486 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1802240~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52416400800001, 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089140060000000004, 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3486 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:43.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910390+0000", 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910392+0000", 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.539e-06 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910402+0000", 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9820000000000003e-06 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910409+0000", 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0779999999999998e-06 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919089+0000", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008680508 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919185+0000", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5760000000000005e-05 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919304+0000", 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119391 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3487 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 1736704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52414082499999, 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090535800000000003, 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3487 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910414+0000", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910413+0000", 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910416+0000", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5749999999999999e-06 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910427+0000", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1038e-05 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910431+0000", 2024-09-21T14:00:43.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7119999999999999e-06 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919319+0000", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088872770000000007 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919389+0000", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0041000000000002e-05 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919467+0000", 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8535000000000006e-05 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3488 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3178496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.524120396, 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092561290000000001, 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3488 2024-09-21T14:00:43.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910434+0000", 2024-09-21T14:00:43.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910435+0000", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4920000000000001e-06 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910442+0000", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910445+0000", 2024-09-21T14:00:43.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.942e-06 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919509+0000", 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090639009999999992 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919605+0000", 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5861999999999998e-05 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919690+0000", 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5076999999999999e-05 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3489 3.19 3:9b501eb9:::rbd_data.1185f0a8fe85.0000000000000003:4 [read 3145728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52410559800001, 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093728200000000005, 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3489 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910449+0000", 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910448+0000", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910450+0000", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.818e-06 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910456+0000", 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9109999999999998e-06 2024-09-21T14:00:43.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910461+0000", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4889999999999997e-06 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919723+0000", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092622060000000003 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919770+0000", 2024-09-21T14:00:43.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7179999999999999e-05 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919822+0000", 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1632000000000003e-05 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3490 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.52408101399999, 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094065680000000006, 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3490 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910473+0000", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910475+0000", 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4889999999999998e-06 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910481+0000", 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910486+0000", 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.318e-06 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919865+0000", 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093793550000000007 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919880+0000", 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4874e-05 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3491 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.524064318, 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094116890000000009, 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3491 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:43.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910490+0000", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910492+0000", 2024-09-21T14:00:43.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9800000000000001e-06 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910497+0000", 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5049999999999998e-06 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910508+0000", 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645999999999999e-05 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919893+0000", 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093847440000000004 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919902+0000", 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2059999999999996e-06 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3498 3.19 3.9d780ad9 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:43.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.524042081, 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094170980000000005, 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3498 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910512+0000", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910514+0000", 2024-09-21T14:00:43.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4200000000000001e-06 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910521+0000", 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1999999999999999e-06 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.910526+0000", 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.955e-06 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919920+0000", 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093939720000000004 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:32.919930+0000", 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:3906 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,truncate 1310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 129.60575377800001, 2024-09-21T14:00:43.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082610819999999995, 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3906 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828801+0000", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828799+0000", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828808+0000", 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6199999999999994e-06 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828830+0000", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1735000000000001e-05 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828841+0000", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1219999999999999e-05 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.828963+0000", 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121414 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829124+0000", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016087799999999999 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.829483+0000", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035927799999999998 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.831469+0000", 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001986102 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.836991+0000", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005522328 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837034+0000", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2759999999999997e-05 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.837062+0000", 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7710000000000001e-05 2024-09-21T14:00:43.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4007 3.19 3:9d8f6957:::rbd_data.1185e0e4cd61.0000000000000001:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 129.43623522999999, 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015965159999999999, 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4007 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998319+0000", 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998317+0000", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998330+0000", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998359+0000", 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8923000000000001e-05 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998373+0000", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4294000000000001e-05 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998434+0000", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1030999999999999e-05 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:33.998508+0000", 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3218000000000003e-05 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.000648+0000", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021403149999999998 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.013991+0000", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013343101 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014097+0000", 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010573000000000001 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014183+0000", 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6008999999999996e-05 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.014284+0000", 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010162600000000001 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:4211 3.0 3:0697fd31:::rbd_data.1185e0e4cd61.000000000000001a:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-21T14:00:43.517 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 129.072996636, 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010031425, 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 4211 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361558+0000", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361557+0000", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361564+0000", 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8010000000000004e-06 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361582+0000", 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7980000000000001e-05 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361591+0000", 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7819999999999999e-06 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361643+0000", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1400000000000003e-05 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.361732+0000", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9622000000000004e-05 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.363547+0000", 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001814633 2024-09-21T14:00:43.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371440+0000", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078927059999999993 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371487+0000", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7289000000000001e-05 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371545+0000", 2024-09-21T14:00:43.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8569000000000001e-05 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:34.371589+0000", 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3909000000000003e-05 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:213149 3.1b 3:dedcab7e:::rbd_data.11853179fc0d.00000000000000aa:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:43.523 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.802591043, 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015831293, 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 213149 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631963+0000", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631961+0000", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631973+0000", 2024-09-21T14:00:43.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2215000000000001e-05 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.631996+0000", 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2784000000000001e-05 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632005+0000", 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9390000000000003e-06 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:43.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632055+0000", 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0046999999999997e-05 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632139+0000", 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4083000000000001e-05 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.632679+0000", 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054045999999999999 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.635596+0000", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029166159999999999 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647688+0000", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091922 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647750+0000", 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1805999999999997e-05 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:43.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:52.647795+0000", 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5065000000000003e-05 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:43.529 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:43.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:00:43.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:43.531 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:43.526+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:43.632 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:43.630+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:43.710 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:43.710 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:43.710 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:43.710 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:43.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:43.733 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:43.727+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:43.834 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:43.830+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:43.888 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:43.889 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:43.889 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:43.889 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:43.889 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:43.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:43.935 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:43.931+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:44.035 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:44.031+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.544065399, 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:44.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:44.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543953776, 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:44.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:44.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.076 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54393395300001, 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543909774, 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:44.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.086 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54388566900001, 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:44.091 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54386716, 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:44.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543857418, 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.096 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:44.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.100 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54383255899999, 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.101 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.105 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54380388200001, 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:44.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54378506400001, 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:44.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.114 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543764393, 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:44.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.120 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543743322, 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:44.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54370747, 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:44.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:44.130 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543675248, 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:44.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:44.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54363960800001, 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.135 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:44.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54360513, 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.140 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:44.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54355056999999, 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:44.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543511405, 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:44.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.543472669, 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:44.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 121.54344791600001, 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:44.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:44.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.165 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:44.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:44.166 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:44.162+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:44.267 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:44.267+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:44.333 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:44.333 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:44.334 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:44.334 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:44.348 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:44.392 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:44.390+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:44.465 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:44.465 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:44.465 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:44.468 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:44.466+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:44.476 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:00:44.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:44.570 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:44.567+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:44.671 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:44.666+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:44.676 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:44.676 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.271928753, 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.231841915, 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:44.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 122.170528659, 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:44.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.706069720999999, 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:44.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.696 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.706022441999998, 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:44.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:44.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.705982939999998, 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:44.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.705943881000003, 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:44.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:44.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177580223, 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:44.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:44.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:44.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177552532999997, 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:44.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177530046999998, 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:44.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177482933999997, 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:44.727 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177462288000001, 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:44.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177437996999998, 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:44.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177417493999997, 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:44.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177395179999998, 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:44.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:44.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177376995000003, 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:44.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177358515000002, 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.753 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177312847000003, 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177288126000001, 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.177269011999996, 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:44.762 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:44.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:44.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:44.766 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:44.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:44.815 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:44.811+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:44.872 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:44.870+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:44.901 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:44.901 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:44.901 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:44.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:45.007 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:45.003+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:45.075 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:45.070+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:45.078 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:45.079 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:45.079 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:45.079 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:45.079 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:45.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:45.177 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:45.174+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:45.265 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.374892967999997, 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.374857739000007, 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:45.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:45.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:45.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:45.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:45.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:45.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.374832370000007, 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:45.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:45.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:45.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.374791827999999, 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:45.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:45.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.374750996000003, 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.266003574999999, 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.296 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:45.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:45.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.660540010000005, 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:45.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:45.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:45.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.733054240000001, 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:45.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.733039044999998, 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:45.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.733029113000001, 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.316 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:45.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.733019566999999, 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:45.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.733010245000003, 2024-09-21T14:00:45.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:45.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:45.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.328 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.732999995999997, 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:45.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:45.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.732009865999999, 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:45.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:45.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.731979435, 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.338 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:45.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:45.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.731966335999999, 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:45.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.344 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.344 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:45.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:45.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.731956500000003, 2024-09-21T14:00:45.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:45.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:45.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.353 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.727852786, 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:45.358 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 55.727833861999997, 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:45.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:45.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225600 3.14 3:2b03425b:::rbd_data.11853b23d9f4.0000000000000063:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.794825015000001, 2024-09-21T14:00:45.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20352477399999999, 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225600 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468965+0000", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468971+0000", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3720000000000001e-06 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:45.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468982+0000", 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696000000000001e-05 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468990+0000", 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9729999999999997e-06 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469045+0000", 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4812999999999998e-05 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469125+0000", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0054000000000003e-05 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469242+0000", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117038 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.470274+0000", 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031726 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672407+0000", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20213378800000001 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672453+0000", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5461999999999999e-05 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672491+0000", 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8686000000000002e-05 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:45.369 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:45.369 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:45.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:45.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:45.370+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:45.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:45.471 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:45.467+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:45.509 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:45.509 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:45.509 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:45.509 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:45.528 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:45.571 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:45.566+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:45.572 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:45.572 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:45.592 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:45.593 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:45.610 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:45.610 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:45.627 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:45.648 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:45.648 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:45.666 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:45.666 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:45.672 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:45.667+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:45.687 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:45.687 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:45.697 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:45.697 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:45.708 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:45.708 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:45.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:45.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:45.770+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:45.873 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:45.867+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:45.876 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:45.876 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:45.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:45.974 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:45.970+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:46.058 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.058 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:46.074 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:46.070+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:46.176 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:46.174+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:46.187 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.187 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:46.277 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:46.274+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:46.321 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.321 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:46.386 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:46.383+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:46.459 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.459 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.473 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:46.500 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T14:00:46.514 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:46.511+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:46.579 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:46.574+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:46.644 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.644 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:46.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:46.678+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:46.775 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.775 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.780 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:46.778+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:46.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:46.881 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:46.878+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:46.908 INFO:tasks.thrashosds.thrasher:in_osds: [3, 4, 5, 6, 7, 1, 2, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:46.908 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:46.909 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [3, 4, 5, 6, 7, 1, 2, 0] 2024-09-21T14:00:46.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-21T14:00:46.912 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:46.912 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:46.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:47.016 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:47.014+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:47.083 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:47.083+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:47.092 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:47.092 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:47.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T14:00:47.184 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:47.179+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:47.233 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T14:00:47.230+0000 7f74c16a6640 -1 mon.a@0(leader).osd e141 definitely_dead 0 2024-09-21T14:00:47.284 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:47.279+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:47.286 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:47.286 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:47.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:47.384 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:47.379+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:47.473 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:47.473 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:47.485 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:47.479+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:47.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:47.586 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:47.579+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:47.602 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:47.602 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:47.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:47.687 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:47.682+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:47.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:47.737 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:47.737 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:47.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:47.800 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:47.798+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:47.871 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:47.872 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:47.887 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:47.888 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:47.888 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:47.886+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:47.903 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:47.904 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:47.921 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:47.925 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:47.926 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:47.926 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:47.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:47.941 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:47.941 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:47.961 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:47.962 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:47.989 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:47.986+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:48.053 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:48.053 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:48.054 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:48.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:48.091 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:48.087+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:48.182 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.3. 2024-09-21T14:00:48.191 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:48.186+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:48.192 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:48.193 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:48.218 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:48.218 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15356 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719365658, 2024-09-21T14:00:48.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81768672799999997, 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15356 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520291+0000", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520298+0000", 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4619999999999999e-06 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520306+0000", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3690000000000001e-06 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520310+0000", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8679999999999998e-06 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520882+0000", 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00057184599999999999 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520888+0000", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1240000000000002e-06 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337970+0000", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81708124599999998 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.337978+0000", 2024-09-21T14:00:48.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1729999999999995e-06 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15360 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.71925403500001, 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81769844000000003, 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15360 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520403+0000", 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520402+0000", 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520407+0000", 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-06 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520411+0000", 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520413+0000", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520981+0000", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056775700000000001 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520984+0000", 2024-09-21T14:00:48.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9689999999999999e-06 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338093+0000", 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81710892700000004 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338101+0000", 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0679999999999997e-06 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15361 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719234212, 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771085700000001, 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15361 2024-09-21T14:00:48.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520423+0000", 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520422+0000", 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520424+0000", 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.531e-06 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520428+0000", 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7459999999999998e-06 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520430+0000", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5500000000000001e-06 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520996+0000", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056546199999999997 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520999+0000", 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0460000000000001e-06 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338126+0000", 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81712727299999999 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338133+0000", 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5270000000000001e-06 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.254 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15362 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719210033, 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81771729199999998, 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15362 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:48.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520447+0000", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520446+0000", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520448+0000", 2024-09-21T14:00:48.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4890000000000001e-06 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520452+0000", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6509999999999999e-06 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520454+0000", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521010+0000", 2024-09-21T14:00:48.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00055580400000000002 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521013+0000", 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338156+0000", 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81714340299999999 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338164+0000", 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5950000000000001e-06 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15363 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719185928, 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81772367199999996, 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.259 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15363 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520471+0000", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520472+0000", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4160000000000001e-06 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520476+0000", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1400000000000002e-06 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520479+0000", 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4159999999999998e-06 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521024+0000", 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054583300000000002 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521027+0000", 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9699999999999999e-06 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338187+0000", 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81715958099999997 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338194+0000", 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15364 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.263 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719167419, 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773278100000002, 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15364 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520489+0000", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520491+0000", 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.474e-06 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520494+0000", 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.552e-06 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520497+0000", 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521039+0000", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00054189799999999997 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521042+0000", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9840000000000001e-06 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338215+0000", 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81717365900000005 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338222+0000", 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9179999999999997e-06 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15365 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719157677, 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775177899999996, 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15365 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:48.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520499+0000", 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520504+0000", 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4559999999999999e-06 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520508+0000", 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5389999999999999e-06 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520511+0000", 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2150000000000001e-06 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521053+0000", 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000541714 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521056+0000", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9809999999999999e-06 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338243+0000", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817187581 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338251+0000", 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5120000000000002e-06 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15366 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.71913281800001, 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775777900000002, 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15366 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520524+0000", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520523+0000", 2024-09-21T14:00:48.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520526+0000", 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8279999999999999e-06 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520533+0000", 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8419999999999999e-06 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520547+0000", 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3916e-05 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521067+0000", 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051977700000000002 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521070+0000", 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0970000000000002e-06 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338274+0000", 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81720406400000001 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338282+0000", 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6720000000000004e-06 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15367 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.277 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719104141, 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81776143000000001, 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15367 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520553+0000", 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520552+0000", 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520555+0000", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.01e-06 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520562+0000", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7750000000000004e-06 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520567+0000", 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5990000000000004e-06 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521081+0000", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051458099999999996 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521084+0000", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.101e-06 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338306+0000", 2024-09-21T14:00:48.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81722203199999999 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338314+0000", 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15368 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719085323, 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817773678, 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15368 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520571+0000", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520580+0000", 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3700000000000001e-06 2024-09-21T14:00:48.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520586+0000", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.631e-06 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520589+0000", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4920000000000002e-06 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521095+0000", 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050621499999999996 2024-09-21T14:00:48.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521098+0000", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9239999999999999e-06 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338337+0000", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.817238884 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338345+0000", 2024-09-21T14:00:48.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.824e-06 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15369 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719064652, 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778491099999995, 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15369 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520592+0000", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967296 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520593+0000", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5430000000000001e-06 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520597+0000", 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4640000000000002e-06 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520599+0000", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4980000000000001e-06 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521109+0000", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050990499999999995 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521112+0000", 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9790000000000002e-06 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338369+0000", 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81725647400000001 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338377+0000", 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2859999999999999e-06 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15370 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.291 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.71904358099999, 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779493000000003, 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15370 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:48.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520613+0000", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520612+0000", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520616+0000", 2024-09-21T14:00:48.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.912e-06 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520624+0000", 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.323e-06 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520629+0000", 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4330000000000003e-06 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521123+0000", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00049407300000000004 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521126+0000", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9900000000000002e-06 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338400+0000", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81727443799999999 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338408+0000", 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5780000000000001e-06 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15371 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.719007729, 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81779009899999999, 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15371 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520649+0000", 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520651+0000", 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8250000000000001e-06 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520659+0000", 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.011e-06 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520664+0000", 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7979999999999996e-06 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521144+0000", 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047942999999999998 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521150+0000", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338431+0000", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728115099999998 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338439+0000", 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1799999999999996e-06 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15372 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718975507, 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778820299999999, 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15372 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520681+0000", 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520688+0000", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1579999999999999e-06 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520694+0000", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4180000000000002e-06 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520699+0000", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521173+0000", 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047370000000000002 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521178+0000", 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0749999999999997e-06 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338462+0000", 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81728376000000003 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338469+0000", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7419999999999997e-06 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15373 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718939867, 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81778206200000003, 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15373 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520717+0000", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520716+0000", 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520719+0000", 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6129999999999998e-06 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520726+0000", 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0960000000000003e-06 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520732+0000", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5539999999999997e-06 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521190+0000", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045870399999999999 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521193+0000", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1549999999999999e-06 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338491+0000", 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81729794499999997 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338499+0000", 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.481e-06 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15374 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718905389, 2024-09-21T14:00:48.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81777666000000004, 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15374 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520751+0000", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520753+0000", 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4600000000000002e-06 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520760+0000", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2600000000000002e-06 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520765+0000", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8620000000000002e-06 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521205+0000", 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000440106 2024-09-21T14:00:48.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521208+0000", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0620000000000001e-06 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338520+0000", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81731246800000001 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338528+0000", 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-21T14:00:48.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15375 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718850829, 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81775077600000001, 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15375 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520806+0000", 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520805+0000", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520809+0000", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2169999999999999e-06 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520821+0000", 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2721999999999999e-05 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520836+0000", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4138000000000001e-05 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521220+0000", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038420899999999999 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521223+0000", 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.044e-06 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338549+0000", 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81732655499999995 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338557+0000", 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15376 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718811664, 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81774154300000002, 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15376 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:48.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520845+0000", 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520847+0000", 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9280000000000002e-06 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520854+0000", 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.596e-06 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520859+0000", 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.464e-06 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521235+0000", 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00037609299999999998 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521238+0000", 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9660000000000001e-06 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338579+0000", 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81734095399999995 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338587+0000", 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0269999999999995e-06 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15377 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.71877292800001, 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773228899999995, 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15377 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520884+0000", 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520883+0000", 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520886+0000", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8830000000000002e-06 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520893+0000", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4030000000000004e-06 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520903+0000", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0848e-05 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521249+0000", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034541200000000002 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521252+0000", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.027e-06 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338608+0000", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81735641999999997 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338616+0000", 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7219999999999999e-06 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:15378 3.0 3.960acda0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 125.718748175, 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81773688099999997, 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15378 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520909+0000", 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520908+0000", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520911+0000", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5009999999999999e-06 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520917+0000", 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8989999999999998e-06 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.520923+0000", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9410000000000004e-06 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521265+0000", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034223700000000001 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.521268+0000", 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338638+0000", 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.81737000299999996 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.338645+0000", 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5179999999999998e-06 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.333 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:48.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:48.335 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:48.330+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:48.436 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:48.431+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:48.505 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:48.505 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:00:48.505 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:48.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:48.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:48.562+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:48.638 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:48.635+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:48.638 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:48.639 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:48.639 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:48.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:48.740 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:48.738+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:48.819 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:48.820 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.41695955, 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.821 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:48.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.37687271199999, 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:48.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 126.315559456, 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:48.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:48.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.851100518000003, 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:48.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.851053239000002, 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:48.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.851013737000002, 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.850974678, 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:48.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322611019999997, 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:48.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:48.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322583330000001, 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:48.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:48.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:48.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322560844000002, 2024-09-21T14:00:48.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:48.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:48.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322513731000001, 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:48.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322493084999998, 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.875 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:48.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:48.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:48.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.879 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322468794000002, 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.883 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322448291000001, 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:48.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:48.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:48.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322425977000002, 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:48.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:48.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:48.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322407792, 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:48.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:48.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.897 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322389311999999, 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322343644, 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:48.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322318922999997, 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.907 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.322299809, 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.912 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:48.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:48.917 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:48.919 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:48.919 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:48.914+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:49.019 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:49.018+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:49.049 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:49.049 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:49.050 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:49.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:49.120 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:49.115+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:49.193 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:49.193 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:49.193 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:49.193 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:49.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:00:49.209 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:49.256 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:49.254+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:49.321 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:49.318+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:49.374 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.374 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:49.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.483425296999997, 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.483390068000006, 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.483364699000006, 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:49.386 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.483324156999998, 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.483283325000002, 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:49.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.374535903999998, 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:49.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:49.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.769072339000004, 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:49.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:49.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:49.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841586569, 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.407 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:49.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:49.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841571373999997, 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:49.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841561442, 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:49.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:49.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:49.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841551895999999, 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:49.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:49.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841542574000002, 2024-09-21T14:00:49.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:49.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.841532325000003, 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:49.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:49.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:49.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.840542194999998, 2024-09-21T14:00:49.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:49.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.840511763999999, 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:49.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.840498664999998, 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:49.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.840488829000002, 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:49.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:49.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:49.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:49.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.836385114999999, 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:49.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:49.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.836366191000003, 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:49.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:49.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225600 3.14 3:2b03425b:::rbd_data.11853b23d9f4.0000000000000063:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 19.903357344, 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20352477399999999, 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225600 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468965+0000", 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468971+0000", 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3720000000000001e-06 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468982+0000", 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696000000000001e-05 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468990+0000", 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9729999999999997e-06 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469045+0000", 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4812999999999998e-05 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469125+0000", 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0054000000000003e-05 2024-09-21T14:00:49.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469242+0000", 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117038 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.470274+0000", 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031726 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672407+0000", 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20213378800000001 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672453+0000", 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5461999999999999e-05 2024-09-21T14:00:49.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672491+0000", 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8686000000000002e-05 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.489 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:49.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:49.492 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:49.486+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:49.591 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:49.587+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:49.620 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:49.620 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:49.635 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:49.692 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:49.690+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:49.793 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:49.790+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:49.802 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.802 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:49.802 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:49.802 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:49.803 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:49.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:49.894 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:49.891+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:49.941 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:49.941 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:49.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:49.941 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:49.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458830292000002, 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:49.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458782184, 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:49.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:49.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458719975999998, 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458671726999995, 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:49.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.959 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458626378999995, 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:49.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:49.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458579927000002, 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:49.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:49.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:49.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458534147999998, 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.972 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.45848909, 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458444631000006, 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:49.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458392243000006, 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:49.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:49.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:49.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458359160000001, 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.986 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:49.990 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458274232999997, 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.994 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458227163999993, 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:49.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:49.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:49.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458181968999995, 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:50.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.458124364, 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:50.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.456688575000001, 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.009 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:50.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.456610454, 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.013 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:50.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 70.456561202000003, 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:50.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:50.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.146439243000003, 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:50.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:50.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:50.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:224424 3.4 3:2039325b:::rbd_data.1185ddc9253f.0000000000000006:head [stat,truncate 7405568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.247366957000001, 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49699188900000002, 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:50.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 224424 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:50.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693148+0000", 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693155+0000", 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5469999999999999e-06 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693175+0000", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.003e-05 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693190+0000", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4759999999999999e-05 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693346+0000", 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015559499999999999 2024-09-21T14:00:50.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693374+0000", 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8577000000000001e-05 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.186889+0000", 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49351429000000002 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:50.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187218+0000", 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000329394 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187469+0000", 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025103199999999999 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189826+0000", 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023566400000000001 2024-09-21T14:00:50.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189869+0000", 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3702999999999998e-05 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189992+0000", 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122946 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:50.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.190141+0000", 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014868499999999999 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:50.035 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:50.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:50.037 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:50.031+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:50.137 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:50.131+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:50.192 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:00:50.214 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:50.214 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:50.214 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:50.214 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:50.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:50.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:50.278 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:50.275+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:50.339 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:50.334+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:50.430 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:50.430 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:50.440 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:50.438+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:50.440 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:50.440 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:50.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:50.465 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:50.466 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:50.487 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:50.487 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:50.513 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:50.513 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:50.535 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:50.536 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:50.540 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:50.535+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:50.557 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:50.557 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:50.577 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:50.577 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:50.596 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:50.596 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:50.610 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:50.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:50.670 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:50.667+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:50.741 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:50.738+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:50.820 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:50.840 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:50.842 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:50.838+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:50.943 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:50.939+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:50.986 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:50.986 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:51.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:51.042+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:51.145 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:51.139+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:51.166 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.166 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:51.246 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:51.239+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:51.312 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.313 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:51.346 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:51.343+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:51.444 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.444 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.447 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:51.443+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:51.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:51.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:51.546+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:51.577 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.577 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:51.684 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:51.682+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:51.750 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:51.747+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:51.760 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.760 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:51.851 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:51.847+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:51.939 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:51.939 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:51.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:51.953 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:51.947+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:52.053 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:52.047+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:52.074 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:52.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:52.154 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:52.155+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:52.215 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:52.215 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:52.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:00:52.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:52.255 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:52.251+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:52.355 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:52.354+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:52.400 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:52.400 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:52.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:52.456 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:52.454+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:52.557 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:52.554+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:52.570 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:52.570 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:52.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:52.620 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:52.676 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:52.674+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:52.758 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:52.754+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:52.761 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:52.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:52.779 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:52.779 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:52.796 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:52.796 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:52.812 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:52.812 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:52.828 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:52.828 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:52.848 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:52.849 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:52.859 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:52.854+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:52.868 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:52.869 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:52.888 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:52.889 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:52.894 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:52.894 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:00:52.894 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-21T14:00:52.894 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-21T14:00:52.894 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:52.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:52.909 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:52.909 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:52.976 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:52.974+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:53.023 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.621222684, 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89557489800000001, 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401577+0000", 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401571+0000", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999933 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401585+0000", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4751e-05 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401610+0000", 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4902999999999999e-05 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401621+0000", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0675e-05 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401691+0000", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9868000000000003e-05 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.401702+0000", 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1255e-05 2024-09-21T14:00:53.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297137+0000", 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89543485899999997 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297152+0000", 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5183e-05 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3.47238808 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.581135846, 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85554613899999998, 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:53.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441664+0000", 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441663+0000", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441668+0000", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2310000000000004e-06 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441677+0000", 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3750000000000003e-06 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441683+0000", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441725+0000", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1538000000000001e-05 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.441731+0000", 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5370000000000003e-06 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297198+0000", 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.85546670800000002 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297210+0000", 2024-09-21T14:00:53.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2386e-05 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:13178 3.8 3:1011c4e2:::rbd_data.1185a7c518d0.0000000000000189:head [stat,delete] snapc b=[b] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 130.51982258999999, 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.80282781199999997, 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 13178 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502977+0000", 2024-09-21T14:00:53.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502976+0000", 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502982+0000", 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5929999999999996e-06 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.502991+0000", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0329999999999997e-06 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503001+0000", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0223e-05 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503060+0000", 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8629999999999999e-05 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:42.503070+0000", 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0547000000000001e-05 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297354+0000", 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.79428386200000001 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.297635+0000", 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028131500000000003 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:58:43.305805+0000", 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081696909999999998 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198822 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1949696~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:53.039 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.055363651999997, 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066708972000000005, 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198822 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967436+0000", 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967435+0000", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967441+0000", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2539999999999998e-06 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967459+0000", 2024-09-21T14:00:53.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8162999999999999e-05 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967474+0000", 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4158999999999999e-05 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033745+0000", 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066271089000000005 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.033853+0000", 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107828 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034145+0000", 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029274800000000001 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198823 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 1994752~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.055316372999997, 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067162801999999994, 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198823 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967484+0000", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967483+0000", 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967488+0000", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1649999999999997e-06 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967502+0000", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4131000000000001e-05 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967513+0000", 2024-09-21T14:00:53.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1123e-05 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034200+0000", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066686775000000004 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034295+0000", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5272999999999994e-05 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034646+0000", 2024-09-21T14:00:53.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035115500000000002 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198824 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.055276871000004, 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067555899000000003, 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198824 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967523+0000", 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967522+0000", 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967527+0000", 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3859999999999998e-06 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967541+0000", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3917000000000001e-05 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967553+0000", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1374e-05 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034702+0000", 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067149552000000001 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.034802+0000", 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9965999999999998e-05 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035079+0000", 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276796 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:198825 3.2 3:44b31f99:::rbd_data.118551b8ee3.0000000000000003:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e88)", 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.055237812000001, 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067912067000000007, 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 198825 2024-09-21T14:00:53.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967562+0000", 2024-09-21T14:00:53.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967561+0000", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967566+0000", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0089999999999998e-06 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967580+0000", 2024-09-21T14:00:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3774000000000001e-05 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:47.967591+0000", 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1165000000000001e-05 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035114+0000", 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067523193999999995 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035213+0000", 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8468000000000007e-05 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:48.035474+0000", 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026131199999999998 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206819 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1024000~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526874153999998, 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066369978999999996, 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206819 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:53.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495926+0000", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495925+0000", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495929+0000", 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:53.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495941+0000", 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2167999999999999e-05 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495948+0000", 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4899999999999997e-06 2024-09-21T14:00:53.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562080+0000", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066131958000000005 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562118+0000", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8574e-05 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562296+0000", 2024-09-21T14:00:53.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017754899999999999 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206820 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1069056~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526846464000002, 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066580317, 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206820 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495953+0000", 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495956+0000", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9550000000000001e-06 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495965+0000", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0650000000000005e-06 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495970+0000", 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562321+0000", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066350955000000003 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562367+0000", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5240000000000001e-05 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562534+0000", 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000167271 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206821 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1114112~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526823978000003, 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066849375000000003, 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206821 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.495976+0000", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496000+0000", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559e-05 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496011+0000", 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1243000000000001e-05 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496017+0000", 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0920000000000003e-06 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562564+0000", 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066546230999999997 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562602+0000", 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8432000000000001e-05 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562825+0000", 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022327299999999999 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206822 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1159168~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526776865000002, 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067070649999999996, 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206822 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496023+0000", 2024-09-21T14:00:53.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496025+0000", 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8509999999999999e-06 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496034+0000", 2024-09-21T14:00:53.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.456e-06 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496039+0000", 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3380000000000004e-06 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562859+0000", 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.066820239000000003 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.562904+0000", 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4462999999999998e-05 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563094+0000", 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018981799999999999 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206823 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1204224~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526756218999999, 2024-09-21T14:00:53.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067409014000000003, 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206823 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496044+0000", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496043+0000", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496046+0000", 2024-09-21T14:00:53.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8959999999999999e-06 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496054+0000", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2109999999999998e-06 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496063+0000", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7450000000000001e-06 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563138+0000", 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067074992999999999 2024-09-21T14:00:53.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563220+0000", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1761999999999994e-05 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563453+0000", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023277399999999999 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206824 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1249280~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:53.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526731927999997, 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067691060999999997, 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206824 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496068+0000", 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496070+0000", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496078+0000", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7919999999999993e-06 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496084+0000", 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9399999999999999e-06 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563483+0000", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067399201000000006 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563555+0000", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1653e-05 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563759+0000", 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020431599999999999 2024-09-21T14:00:53.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206825 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1294336~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526711425000002, 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068090670000000006, 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206825 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496089+0000", 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496088+0000", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496091+0000", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3599999999999999e-06 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496099+0000", 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1980000000000001e-06 2024-09-21T14:00:53.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496106+0000", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8970000000000002e-06 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563809+0000", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.067703709000000001 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.563896+0000", 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6199000000000006e-05 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564179+0000", 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028366200000000001 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206826 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526689111000003, 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068375868000000006, 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206826 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496111+0000", 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496110+0000", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496113+0000", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5299999999999999e-06 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496119+0000", 2024-09-21T14:00:53.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496124+0000", 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3079999999999998e-06 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564211+0000", 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068087007000000005 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564275+0000", 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3989e-05 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564487+0000", 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000211277 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206827 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1384448~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.094 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526670926000001, 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068644360000000001, 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206827 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496129+0000", 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496131+0000", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4590000000000001e-06 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496138+0000", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1040000000000001e-06 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496143+0000", 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.994e-06 2024-09-21T14:00:53.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564513+0000", 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068369891000000002 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564576+0000", 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2619999999999993e-05 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564773+0000", 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019764399999999999 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206828 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1429504~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526652446, 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069106999000000002, 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206828 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496147+0000", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496150+0000", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7360000000000001e-06 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496158+0000", 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:53.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496165+0000", 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564897+0000", 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.068731649000000006 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.564982+0000", 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5586000000000004e-05 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565254+0000", 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027229899999999999 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206829 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1474560~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.103 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526606778000001, 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069347836999999996, 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206829 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496193+0000", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496192+0000", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496196+0000", 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.365e-06 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496207+0000", 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1396000000000001e-05 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496213+0000", 2024-09-21T14:00:53.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5620000000000003e-06 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565295+0000", 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069082298 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565340+0000", 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4988999999999999e-05 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565541+0000", 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020101299999999999 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206830 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1519616~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526582056999999, 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069609204999999993, 2024-09-21T14:00:53.108 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206830 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496218+0000", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496217+0000", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496220+0000", 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496227+0000", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7510000000000002e-06 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496232+0000", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.921e-06 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565569+0000", 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069336925999999993 2024-09-21T14:00:53.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565629+0000", 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9892000000000002e-05 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565827+0000", 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000198352 2024-09-21T14:00:53.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4485.0:206831 3.18 3:1b854c06:::rbd_data.118551b8ee3.0000000000000002:21 [read 1564672~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 63.526562943000002, 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069799254000000005, 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-21T14:00:53.113 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4485", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 206831 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-21T14:00:53.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496237+0000", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496239+0000", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.571e-06 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496246+0000", 2024-09-21T14:00:53.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3980000000000004e-06 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.496251+0000", 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2429999999999996e-06 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565850+0000", 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.069599094 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-21T14:00:53.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.565897+0000", 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6640000000000001e-05 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-21T13:59:49.566036+0000", 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013969399999999999 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:53.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:53.118 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:53.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:53.122 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:53.114+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:53.207 INFO:tasks.thrashosds.thrasher:in_osds: [4, 5, 6, 7, 1, 2, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:53.208 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:53.208 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-21T14:00:53.208 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.586079 2024-09-21T14:00:53.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.5860794649285149 2024-09-21T14:00:53.220 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:00:53.223 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:53.218+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.4.0:3110 3.14 e147/97)", 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.280182+0000", 2024-09-21T14:00:53.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001217938, 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012568600000000001, 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280182+0000", 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280182+0000", 2024-09-21T14:00:53.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280181+0000", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280185+0000", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4449999999999998e-06 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280197+0000", 2024-09-21T14:00:53.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1933000000000001e-05 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.280204+0000", 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0600000000000002e-06 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.7.0:362 3.15 e147/145 3:adfdcc02:::rbd_data.1185ba4f1d0d.000000000000024d:12 v 147'510, mlcod=147'506)", 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.281069+0000", 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00033082599999999999, 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00049729500000000003, 2024-09-21T14:00:53.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281069+0000", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281069+0000", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281068+0000", 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281076+0000", 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0800000000000006e-06 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281091+0000", 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5004000000000001e-05 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281100+0000", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1370000000000008e-06 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281154+0000", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3832999999999998e-05 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281187+0000", 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3046999999999997e-05 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.4.0:3111 3.3 e147/117)", 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.281312+0000", 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.7962999999999998e-05, 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000384478, 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281312+0000", 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281312+0000", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281311+0000", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281317+0000", 2024-09-21T14:00:53.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8810000000000001e-06 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281332+0000", 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5136e-05 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.281340+0000", 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0749999999999998e-06 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.290 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2836 3.1b e147/116 3:df75ea21:::rbd_data.1185ba4f1d0d.0000000000000173:12 v 147'402, mlcod=147'398)", 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.277747+0000", 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0036522270000000001, 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004064944, 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277747+0000", 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277747+0000", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277747+0000", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277756+0000", 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9360000000000005e-06 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277768+0000", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1997999999999999e-05 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277775+0000", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4000000000000003e-06 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277844+0000", 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277871+0000", 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6843e-05 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.4.0:3109 3.3 e147/117)", 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.277787+0000", 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0036126919999999998, 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041619029999999998, 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277787+0000", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277787+0000", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277787+0000", 2024-09-21T14:00:53.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277790+0000", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4180000000000001e-06 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277798+0000", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8900000000000007e-06 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277803+0000", 2024-09-21T14:00:53.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3109999999999996e-06 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.4.0:3108 3.14 e147/97)", 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.277872+0000", 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003527929, 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004181237, 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277872+0000", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277872+0000", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277871+0000", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277875+0000", 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0300000000000004e-06 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277884+0000", 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.081e-06 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.277890+0000", 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8089999999999998e-06 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.5.0:3582 3.1d e147/23 3:b9209161:::rbd_data.1185ba4f1d0d.000000000000004c:12 v 147'853, mlcod=147'849)", 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.279513+0000", 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0018867479999999999, 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002648053, 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279513+0000", 2024-09-21T14:00:53.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279513+0000", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279511+0000", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279525+0000", 2024-09-21T14:00:53.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3349e-05 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279551+0000", 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5865000000000001e-05 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279583+0000", 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2474000000000001e-05 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279697+0000", 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114471 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.279724+0000", 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6370999999999999e-05 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-09-21T14:00:53.303 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:53.305 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:53.320 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:53.318+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:53.421 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:53.418+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:53.431 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:53.431 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:53.445 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:53.522 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:53.518+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:53.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.677862993999995, 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:53.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.677827765000004, 2024-09-21T14:00:53.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:53.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.677802396000004, 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.677761853999996, 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.581 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:53.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.677721022, 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:53.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.568973600999996, 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:53.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.963510036000002, 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:53.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.036024265999998, 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:53.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:53.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.036009070999995, 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:53.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.035999138999998, 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:53.609 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:53.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.035989592999996, 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:53.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:53.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:53.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.035980271, 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:53.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:53.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.035970022000001, 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:53.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.034979891999996, 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:53.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:53.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:53.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.034949460999997, 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:53.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:53.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.034936361999996, 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.034926526000007, 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.030822811999997, 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:53.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:53.648 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.030803887999994, 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:53.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:53.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225600 3.14 3:2b03425b:::rbd_data.11853b23d9f4.0000000000000063:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.097795041000001, 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20352477399999999, 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:53.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225600 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:53.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468965+0000", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468971+0000", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3720000000000001e-06 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468982+0000", 2024-09-21T14:00:53.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696000000000001e-05 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468990+0000", 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9729999999999997e-06 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469045+0000", 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4812999999999998e-05 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469125+0000", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0054000000000003e-05 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469242+0000", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117038 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.470274+0000", 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031726 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672407+0000", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20213378800000001 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672453+0000", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5461999999999999e-05 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672491+0000", 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8686000000000002e-05 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:53.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:53.659 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:53.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:53.661 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:53.655+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:53.761 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:53.755+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:53.828 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:53.828 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:53.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:53.862 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:53.858+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:53.962 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:53.959+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:54.015 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:54.015 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:54.015 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:54.016 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:54.016 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:54.030 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:54.074 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:54.071+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:54.164 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:54.162+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:54.202 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718864480999997, 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.203 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:54.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:54.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:54.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718816372999996, 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:54.210 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:54.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718754165000007, 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:54.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718705916000005, 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:54.223 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718660568000004, 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:54.227 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718614115999998, 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:54.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:54.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:54.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718568336999994, 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:54.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718523278999996, 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:54.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:54.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718478820000001, 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:54.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718426432000001, 2024-09-21T14:00:54.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.249 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718393348999996, 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:54.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718308422000007, 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:54.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718261353000003, 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.258 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:54.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718216158000004, 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.718158552999995, 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:54.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.716722763999996, 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.716644642999995, 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:54.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.716595390999998, 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:54.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:54.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.406473431999999, 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:54.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:54.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:54.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:224424 3.4 3:2039325b:::rbd_data.1185ddc9253f.0000000000000006:head [stat,truncate 7405568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.507401145999999, 2024-09-21T14:00:54.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49699188900000002, 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 224424 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693148+0000", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693155+0000", 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5469999999999999e-06 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693175+0000", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.003e-05 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693190+0000", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4759999999999999e-05 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693346+0000", 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015559499999999999 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693374+0000", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8577000000000001e-05 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.186889+0000", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49351429000000002 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187218+0000", 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000329394 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187469+0000", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025103199999999999 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189826+0000", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023566400000000001 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189869+0000", 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3702999999999998e-05 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189992+0000", 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122946 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.190141+0000", 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014868499999999999 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.295 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:54.297 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.7 primary-affinity to 0.586079 (8384092) 2024-09-21T14:00:54.298 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:54.298 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:54.294+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:54.398 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:54.391+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:54.429 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:54.429 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:54.429 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:54.429 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:54.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:54.538 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:54.535+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:54.599 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:54.595+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:54.605 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:54.606 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:54.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:54.710 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:54.707+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:54.788 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.910649983, 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.90277282, 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89883579799999, 2024-09-21T14:00:54.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.898824589, 2024-09-21T14:00:54.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:54.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:54.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:54.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.898813417, 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:54.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.898799114, 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.810 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:54.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89876365400001, 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.898750491, 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:54.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89873896, 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.894750992, 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89473135999999, 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:54.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:54.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.894706532, 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:54.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.894681535, 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:54.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89466946500001, 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:54.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:54.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:54.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89465814499999, 2024-09-21T14:00:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:54.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:54.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89464700400001, 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.89463470299999, 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:54.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:54.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:54.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 127.894623451, 2024-09-21T14:00:54.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 125.81855369900001, 2024-09-21T14:00:54.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:54.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 125.809327123, 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:54.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:54.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:54.874 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:54.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:54.875 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:54.870+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:54.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:54.975 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:54.971+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:55.044 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:55.044 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:55.044 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:55.044 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:55.058 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:55.078 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:55.078 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:55.093 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:55.094 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:55.102 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:55.099+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:55.109 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:55.109 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:55.124 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:55.143 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:55.144 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:55.161 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:55.161 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:55.177 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:55.174+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:55.180 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:55.180 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:55.199 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:55.200 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:55.230 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:55.231 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:55.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:00:55.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:55.304 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:55.302+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:55.379 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:55.374+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:55.386 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:55.386 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:55.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:55.480 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:55.478+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:55.516 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:55.516 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:55.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:55.581 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:55.575+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:55.682 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:55.679+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:55.692 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:55.693 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:55.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:00:55.783 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:55.778+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:55.826 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:55.826 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:55.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:00:55.884 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:55.882+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:55.985 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:55.983+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:56.008 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.008 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:00:56.086 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:56.082+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:56.140 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.140 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:00:56.187 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:56.183+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:56.231 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:00:56.288 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:56.283+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:56.325 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.325 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.340 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:00:56.389 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:56.383+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:56.466 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.466 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:00:56.490 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:56.487+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:56.591 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:56.586+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:56.601 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.601 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.615 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:00:56.692 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:56.687+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:56.779 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.779 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.792 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:56.787+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:56.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:00:56.893 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:56.891+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:56.918 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:56.918 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:56.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:00:56.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:56.990+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:57.055 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:57.055 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:57.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:00:57.095 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:57.095+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:57.198 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:57.191+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:57.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:00:57.244 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:57.245 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:57.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:00:57.310 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:57.307+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:57.374 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:57.374 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:57.390 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:57.390 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:57.394 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:57.395 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:57.397 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:57.391+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:57.405 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:57.406 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:57.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:00:57.421 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:57.421 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:57.441 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:57.459 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:57.459 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:57.476 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:57.476 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:57.493 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:57.493 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:57.497 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:00:57.494+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:00:57.571 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:57.571 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:57.571 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:57.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:00:57.630 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:57.627+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:57.699 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:57.694+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:00:57.708 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.817781105999998, 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:00:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:00:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.817745876999993, 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:00:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:00:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.817720507999994, 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:00:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.817679966, 2024-09-21T14:00:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.817639134000004, 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 82.708891713, 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 79.103428148000006, 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:00:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:00:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175942378000002, 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:00:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175927182999999, 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:00:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175917251000001, 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:00:57.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175907705, 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:00:57.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:00:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:00:57.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175898383000003, 2024-09-21T14:00:57.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:00:57.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:00:57.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.175888134000004, 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.174898003999999, 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:00:57.766 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:00:57.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:00:57.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.174867573, 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:00:57.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.174854474, 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:00:57.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.779 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.174844637999996, 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:00:57.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:00:57.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.170740924, 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:00:57.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:00:57.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.170721999999998, 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:00:57.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:00:57.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:00:57.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225600 3.14 3:2b03425b:::rbd_data.11853b23d9f4.0000000000000063:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.237713153000001, 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20352477399999999, 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225600 2024-09-21T14:00:57.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468965+0000", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468971+0000", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3720000000000001e-06 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468982+0000", 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696000000000001e-05 2024-09-21T14:00:57.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468990+0000", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9729999999999997e-06 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469045+0000", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4812999999999998e-05 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469125+0000", 2024-09-21T14:00:57.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0054000000000003e-05 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469242+0000", 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117038 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.470274+0000", 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031726 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672407+0000", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20213378800000001 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672453+0000", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5461999999999999e-05 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672491+0000", 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8686000000000002e-05 2024-09-21T14:00:57.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:57.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:57.799 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:57.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:00:57.801 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:57.798+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:57.901 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:57.895+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:57.972 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:57.972 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:57.972 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:57.972 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:57.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:00:58.001 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:57.998+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:58.102 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:58.099+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:58.150 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:58.151 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:58.151 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:58.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:00:58.206 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:58.203+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:58.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-21T14:00:58.304 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:58.299+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:58.345 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.862045465999998, 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:00:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:00:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861997357999996, 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:00:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861935149999994, 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:00:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861886901000005, 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:00:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:00:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861841553000005, 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:00:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861795100999998, 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:00:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:00:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:00:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861749321999994, 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:00:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861704263999997, 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:00:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861659805000002, 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:00:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861607417000002, 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:00:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861574333999997, 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:00:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861489406999993, 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861442338000003, 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861397143000005, 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:00:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:00:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.861339537999996, 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:00:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.859903748999997, 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.859825627999996, 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:00:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 78.859776375999999, 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:00:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.549654416999999, 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:00:58.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:224424 3.4 3:2039325b:::rbd_data.1185ddc9253f.0000000000000006:head [stat,truncate 7405568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.650582131, 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49699188900000002, 2024-09-21T14:00:58.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 224424 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693148+0000", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693155+0000", 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5469999999999999e-06 2024-09-21T14:00:58.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693175+0000", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.003e-05 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693190+0000", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4759999999999999e-05 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693346+0000", 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015559499999999999 2024-09-21T14:00:58.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693374+0000", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8577000000000001e-05 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.186889+0000", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49351429000000002 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187218+0000", 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000329394 2024-09-21T14:00:58.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187469+0000", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025103199999999999 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189826+0000", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023566400000000001 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189869+0000", 2024-09-21T14:00:58.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3702999999999998e-05 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189992+0000", 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122946 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.190141+0000", 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014868499999999999 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.440 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:58.441 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:00:58.441 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:58.435+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:58.542 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:58.539+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:58.609 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:58.609 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:58.609 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:58.609 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:58.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:00:58.666 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:58.663+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:58.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:00:58.742+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:00:58.790 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:58.790 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:58.790 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:58.790 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:58.790 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:58.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:00:58.850 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:58.847+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.049149271, 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:00:58.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.04127210799999, 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:00:58.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:00:58.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03733508600001, 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03732387700001, 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.941 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:00:58.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:00:58.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03731270500001, 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:00:58.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.949 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.037298402, 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:58.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:00:58.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03726294200001, 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:00:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03724977900001, 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:00:58.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:00:58.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03723824799999, 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:58.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:00:58.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:58.966 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03325028, 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.970 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.033230648, 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:00:58.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:00:58.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03320582000001, 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:00:58.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:00:58.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:00:58.978 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03318082300001, 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.979 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:00:58.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03316875300001, 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:00:58.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03315743300001, 2024-09-21T14:00:58.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:00:58.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:58.991 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.033146292, 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.995 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.033133991, 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:00:58.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:00:58.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:58.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 132.03312273899999, 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:59.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:00:59.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.957052987, 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 129.94782641099999, 2024-09-21T14:00:59.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:00:59.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:00:59.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.013 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:59.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:00:59.015 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:59.011+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:59.115 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:59.111+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:59.187 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:59.187 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:00:59.187 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:59.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:00:59.246 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:00:59.243+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:00:59.270 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-21T14:00:59.299 INFO:tasks.thrashosds.thrasher:in_osds: [4, 5, 6, 7, 1, 2, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:00:59.299 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:00:59.299 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-21T14:00:59.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-21T14:00:59.317 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:00:59.311+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:00:59.387 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:00:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:00:59.387 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:00:59.387 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:59.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:00:59.417 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:59.414+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:59.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:00:59.518 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:00:59.515+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.055308764000003, 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:00:59.575 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:00:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:00:59.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.055240978999997, 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:00:59.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:00:59.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.055206605999999, 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:00:59.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 59.416402806999997, 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:00:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.37212942, 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:00:59.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219981 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.265268605000003, 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011813077999999999, 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219981 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307591+0000", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307594+0000", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1760000000000002e-06 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307599+0000", 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.541e-06 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.307603+0000", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312228+0000", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046249100000000003 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312313+0000", 2024-09-21T14:00:59.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4503000000000001e-05 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.312550+0000", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000237242 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315354+0000", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028040920000000002 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319277+0000", 2024-09-21T14:00:59.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039234350000000003 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319352+0000", 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4459e-05 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319404+0000", 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2546999999999997e-05 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.264777013, 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:00:59.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:00:59.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.611 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.263780787000002, 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:00:59.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:59.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.263747983999998, 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:00:59.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:00:59.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.623 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.262854785000002, 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:00:59.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:00:59.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:59.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 51.852186539999998, 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:59.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:00:59.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:00:59.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225656 3.f 3:f06e83f4:::rbd_header.1185becdc07b:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:00:59.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 29.208595045999999, 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012824129, 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225656 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364261+0000", 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364280+0000", 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8294000000000001e-05 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364322+0000", 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2765999999999997e-05 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364346+0000", 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.421e-05 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364481+0000", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013467500000000001 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364493+0000", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1737e-05 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.371885+0000", 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073922550000000004 2024-09-21T14:00:59.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.372324+0000", 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043909 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.373143+0000", 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081840700000000005 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376653+0000", 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035104120000000001 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376838+0000", 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000184709 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376984+0000", 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014582899999999999 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.377089+0000", 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010527900000000001 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.7.0:293 3.15 e138/99 ondisk, result = 0)", 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.081119006, 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011962766999999999, 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:59.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491739+0000", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491749+0000", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5899999999999997e-06 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491774+0000", 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4987e-05 2024-09-21T14:00:59.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491791+0000", 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6915999999999999e-05 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503491+0000", 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011700293 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503510+0000", 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8677000000000001e-05 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503704+0000", 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019375100000000001 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229160 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch reconnect cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:00:59.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.376628548999999, 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.051632057, 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229160 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:00:59.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196230+0000", 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196237+0000", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196261+0000", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4292000000000001e-05 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196273+0000", 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1178999999999999e-05 2024-09-21T14:00:59.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196398+0000", 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012588700000000001 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196431+0000", 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999997e-05 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246497+0000", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0500661099999999 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246589+0000", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1217000000000004e-05 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247840+0000", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001251895 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247863+0000", 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2855000000000001e-05 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229161 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch ping cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3754312389999992, 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050481878000000001, 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229161 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197425+0000", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197443+0000", 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8499999999999999e-05 2024-09-21T14:00:59.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197487+0000", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3408999999999997e-05 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197512+0000", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5412999999999999e-05 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197595+0000", 2024-09-21T14:00:59.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2562e-05 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197609+0000", 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4405e-05 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246620+0000", 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049010552999999998 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:00:59.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246729+0000", 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108902 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247897+0000", 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001168627 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247910+0000", 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3193000000000001e-05 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.18 144/143 [PushOp(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e, version: 50'171, data_included: [38912~40960,159744~34816,362496~2048,366592~2048,372736~2048,376832~2048,382976~2048,387072~2048,393216~2048,397312~2048,401408~22528], data_size: 114688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e@50'171, size: 423936, copy_subset: [0~423936], clone_subset: {}, snapset: e=[]:{e=[e]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:423936, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2387327250000002, 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016137994999999999, 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334126+0000", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334244+0000", 2024-09-21T14:00:59.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118025 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334257+0000", 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2165e-05 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334268+0000", 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1275e-05 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334327+0000", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9472000000000003e-05 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334335+0000", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4889999999999998e-06 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350265+0000", 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015930257 2024-09-21T14:00:59.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPushReply(3.7 144/143 [PushReplyOp(3:e3b9eed5:::rbd_data.1185ba4f1d0d.0000000000000021:12)])", 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2380573209999994, 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015399133000000001, 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334806+0000", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0319999999999997e-06 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334813+0000", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.041e-06 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334818+0000", 2024-09-21T14:00:59.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.566e-06 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334860+0000", 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2330000000000003e-05 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350202+0000", 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015341662000000001 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229552 3.e 3:77344450:::rbd_object_map.1185ba4f1d0d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.3197475230000002, 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018807949000000001, 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229552 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253108+0000", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253129+0000", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0069999999999999e-05 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253174+0000", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.507e-05 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253196+0000", 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-05 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253329+0000", 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013327599999999999 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253560+0000", 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023107100000000001 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.254034+0000", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047362400000000002 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.255788+0000", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017547769999999999 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271806+0000", 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01601735 2024-09-21T14:00:59.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271866+0000", 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0056000000000002e-05 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271920+0000", 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4419000000000002e-05 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2969 3.12 e153/117 3:4e9dc24d:::rbd_data.1185cd54b1ab.0000000000000001:c v 153'981, mlcod=152'978)", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.29733276199999997, 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023706353999999999, 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275534+0000", 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.52e-06 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275559+0000", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4691000000000001e-05 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275570+0000", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1031e-05 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275713+0000", 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014284200000000001 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275744+0000", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0916e-05 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299134+0000", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023389969 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299233+0000", 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9698999999999995e-05 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2971 3.12 e153/117 3:4ed65898:::rbd_data.1185cd54b1ab.0000000000000005:c v 153'983, mlcod=152'978)", 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.290784137, 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017367852999999999, 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282074+0000", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282087+0000", 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2891000000000001e-05 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282102+0000", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4834000000000001e-05 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282112+0000", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5619999999999993e-06 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288501+0000", 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063891599999999996 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288551+0000", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0049000000000001e-05 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299408+0000", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010856872 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299444+0000", 2024-09-21T14:00:59.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5941e-05 2024-09-21T14:00:59.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:00:59.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:00:59.681 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:00:59.683 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:59.679+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 153, 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "af11199c-39d9-4003-9df0-1f9fd66ab792", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-21T13:57:52.430765+0000", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-21T14:00:59.263029+0000", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-21T13:59:59.502742+0000", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-21T14:00:48.173696+0000", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5806080, 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-21T14:00:59.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "noscrub", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 5, 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-21T14:00:59.685 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "luminous", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "reef", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:05.200492+0000", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:59.686 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-21T14:00:59.687 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "17", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:59.688 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:59.689 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:59.690 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:59.691 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.94825935363769531, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:10.681325+0000", 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:59.693 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:59.694 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "21", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 21, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:59.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:59.696 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:59.697 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 3, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 3, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.75, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2.25, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2.25, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.94825935363769531, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-21T13:58:20.114253+0000", 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-21T14:00:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-21T14:00:59.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "153", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 69, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 153, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-21T14:00:59.701 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.702 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-21T14:00:59.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 2.2400000095367432, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 2.2400000095367432, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.9700000286102295, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.9700000286102295, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.94825935363769531, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.94999998807907104, 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.94999998807907104 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T14:00:59.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "4f3cec52-e90a-4dc6-8a9d-879659a7f8b3", 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 148, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.705 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.706 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.708 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3285725925 2024-09-21T14:00:59.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6818/3285725925", 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6823/3285725925", 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/3285725925", 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6827/3285725925", 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "f30fdaae-2baf-49e5-b8c2-24477eabf5c6", 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.308349609375, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 86, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.714 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1533952849 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.715 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6819/1533952849", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6822/1533952849", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6830/1533952849", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6826/1533952849", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "54acbaba-89a5-4b6c-bd93-89e0683f2125", 2024-09-21T14:00:59.716 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.1219024658203125, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 42, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-21T14:00:59.717 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-21T14:00:59.718 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.719 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-21T14:00:59.720 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3403916996 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/3403916996", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/3403916996", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/3403916996", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/3403916996", 2024-09-21T14:00:59.721 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "76fc66bf-6186-4666-b92f-c8093d20d625", 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.722 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-21T14:00:59.723 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.724 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-21T14:00:59.726 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3937234571 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/3937234571", 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/3937234571", 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/3937234571", 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/3937234571", 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T14:00:59.727 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c90b7f74-168e-4c89-b1cf-c9ce463afa6e", 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 148, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6824", 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6825", 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.729 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6826", 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6827", 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.730 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6830", 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6831", 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.731 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6828", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6829", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3468135680 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6825/3468135680", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6827/3468135680", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6831/3468135680", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6829/3468135680", 2024-09-21T14:00:59.732 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "b837d993-44f1-4dd3-99f7-675e6abcd9c7", 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.733 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 148, 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6816", 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6817", 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.734 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6818", 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6819", 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6822", 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6823", 2024-09-21T14:00:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6820", 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6821", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 3245816486 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6817/3245816486", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6819/3245816486", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6823/3245816486", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6821/3245816486", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "c68ceefc-f355-4f66-870e-95ce4a9bc37e", 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 117, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-21T14:00:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6808", 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6809", 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6810", 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6811", 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6814", 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6815", 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6812", 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6813", 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2399307560 2024-09-21T14:00:59.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6809/2399307560", 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6811/2399307560", 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6815/2399307560", 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6813/2399307560", 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T14:00:59.744 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "e1909a46-859c-45e8-b84b-0e11db556c48", 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0.5860748291015625, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 13, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 43, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 94, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 145, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 45, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.745 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6800", 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6801", 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6802", 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6803", 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6806", 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6807", 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-21T14:00:59.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6804", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.134:6805", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 912917640 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.134:6801/912917640", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.134:6803/912917640", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.134:6807/912917640", 2024-09-21T14:00:59.749 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.134:6805/912917640", 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.750 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.368141+0000", 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343412+0000", 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.343898+0000", 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.752 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.285851+0000", 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.330406+0000", 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.151465+0000", 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.754 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.197502+0000", 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540138322906710015, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-21T14:00:59.755 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-21T13:58:00.171570+0000", 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 45 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [ 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "3.1e", 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: 5, 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: 6 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-21T14:00:59.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 12, 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 6 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [ 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.758 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 12, 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-21T14:00:59.759 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-21T14:00:59.760 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-21T14:00:59.760 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-21T14:00:59.760 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-21T14:00:59.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T14:00:59.760 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:00:59.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:00:59.761 INFO:tasks.thrashosds.thrasher:j is {'epoch': 153, 'fsid': 'af11199c-39d9-4003-9df0-1f9fd66ab792', 'created': '2024-09-21T13:57:52.430765+0000', 'modified': '2024-09-21T14:00:59.263029+0000', 'last_up_change': '2024-09-21T13:59:59.502742+0000', 'last_in_change': '2024-09-21T14:00:48.173696+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T13:58:05.200492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9482593536376953, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-21T13:58:10.681325+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9482593536376953, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-21T13:58:20.114253+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 69, 'snap_epoch': 153, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.9700000286102295, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.9482593536376953, 'average_primary_affinity': 0.949999988079071, 'average_primary_affinity_weighted': 0.949999988079071}}], 'osds': [{'osd': 0, 'uuid': '4f3cec52-e90a-4dc6-8a9d-879659a7f8b3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6818', 'nonce': 3285725925}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 3285725925}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6829', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 3285725925}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6825', 'nonce': 3285725925}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 3285725925}]}, 'public_addr': '172.21.15.79:6818/3285725925', 'cluster_addr': '172.21.15.79:6823/3285725925', 'heartbeat_back_addr': '172.21.15.79:6831/3285725925', 'heartbeat_front_addr': '172.21.15.79:6827/3285725925', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f30fdaae-2baf-49e5-b8c2-24477eabf5c6', 'up': 1, 'in': 1, 'weight': 0.308349609375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 86, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6817', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1533952849}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6821', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6822', 'nonce': 1533952849}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6830', 'nonce': 1533952849}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1533952849}, {'type': 'v1', 'addr': '172.21.15.79:6826', 'nonce': 1533952849}]}, 'public_addr': '172.21.15.79:6819/1533952849', 'cluster_addr': '172.21.15.79:6822/1533952849', 'heartbeat_back_addr': '172.21.15.79:6830/1533952849', 'heartbeat_front_addr': '172.21.15.79:6826/1533952849', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '54acbaba-89a5-4b6c-bd93-89e0683f2125', 'up': 1, 'in': 1, 'weight': 0.1219024658203125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 42, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 3403916996}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 3403916996}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 3403916996}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 3403916996}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 3403916996}]}, 'public_addr': '172.21.15.79:6801/3403916996', 'cluster_addr': '172.21.15.79:6803/3403916996', 'heartbeat_back_addr': '172.21.15.79:6807/3403916996', 'heartbeat_front_addr': '172.21.15.79:6805/3403916996', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '76fc66bf-6186-4666-b92f-c8093d20d625', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 3937234571}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 3937234571}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 3937234571}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 3937234571}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 3937234571}]}, 'public_addr': '172.21.15.79:6809/3937234571', 'cluster_addr': '172.21.15.79:6811/3937234571', 'heartbeat_back_addr': '172.21.15.79:6815/3937234571', 'heartbeat_front_addr': '172.21.15.79:6813/3937234571', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c90b7f74-168e-4c89-b1cf-c9ce463afa6e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6824', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6825', 'nonce': 3468135680}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6826', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6827', 'nonce': 3468135680}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6830', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6831', 'nonce': 3468135680}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6828', 'nonce': 3468135680}, {'type': 'v1', 'addr': '172.21.15.134:6829', 'nonce': 3468135680}]}, 'public_addr': '172.21.15.134:6825/3468135680', 'cluster_addr': '172.21.15.134:6827/3468135680', 'heartbeat_back_addr': '172.21.15.134:6831/3468135680', 'heartbeat_front_addr': '172.21.15.134:6829/3468135680', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b837d993-44f1-4dd3-99f7-675e6abcd9c7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 148, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6816', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6817', 'nonce': 3245816486}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6818', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6819', 'nonce': 3245816486}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6822', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6823', 'nonce': 3245816486}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6820', 'nonce': 3245816486}, {'type': 'v1', 'addr': '172.21.15.134:6821', 'nonce': 3245816486}]}, 'public_addr': '172.21.15.134:6817/3245816486', 'cluster_addr': '172.21.15.134:6819/3245816486', 'heartbeat_back_addr': '172.21.15.134:6823/3245816486', 'heartbeat_front_addr': '172.21.15.134:6821/3245816486', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'c68ceefc-f355-4f66-870e-95ce4a9bc37e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6808', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6809', 'nonce': 2399307560}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6810', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6811', 'nonce': 2399307560}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6814', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6815', 'nonce': 2399307560}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6812', 'nonce': 2399307560}, {'type': 'v1', 'addr': '172.21.15.134:6813', 'nonce': 2399307560}]}, 'public_addr': '172.21.15.134:6809/2399307560', 'cluster_addr': '172.21.15.134:6811/2399307560', 'heartbeat_back_addr': '172.21.15.134:6815/2399307560', 'heartbeat_front_addr': '172.21.15.134:6813/2399307560', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'e1909a46-859c-45e8-b84b-0e11db556c48', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5860748291015625, 'last_clean_begin': 13, 'last_clean_end': 43, 'up_from': 94, 'up_thru': 145, 'down_at': 45, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 912917640}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 912917640}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 912917640}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 912917640}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 912917640}]}, 'public_addr': '172.21.15.134:6801/912917640', 'cluster_addr': '172.21.15.134:6803/912917640', 'heartbeat_back_addr': '172.21.15.134:6807/912917640', 'heartbeat_front_addr': '172.21.15.134:6805/912917640', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.368141+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343412+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.343898+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.285851+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.330406+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.151465+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.197502+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-21T13:58:00.171570+0000', 'dead_epoch': 45}], 'pg_upmap': [{'pgid': '3.1e', 'osds': [5, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 12, 'length': 6}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 12, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-21T14:00:59.761 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-21T14:00:59.762 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:00:59.762 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:00:59.762 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:00:59.762 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:00:59.763 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:00:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:00:59.763 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:00:59.763 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:00:59.764 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:00:59.764 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:00:59.764 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:00:59.764 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:00:59.765 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:00:59.765 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:00:59.778 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:00:59.778 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:00:59.783 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:00:59.779+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:00:59.885 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:00:59.882+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:00:59.892 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:00:59.893 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:00:59.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:00:59.992 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:00:59.990+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:00.072 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.072 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:01:00.089 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:00.082+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:00.188 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:00.186+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:00.252 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.252 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:01:00.291 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:00.287+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:00.390 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:00.386+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:00.442 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.443 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:01:00.504 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:00.502+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:00.592 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:00.587+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:00.621 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.622 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:01:00.692 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:00.690+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:00.760 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.760 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:01:00.793 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:00.791+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:00.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:00.890+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:00.942 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:00.942 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:00.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:01:01.000 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:00.998+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:01.096 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:01:01.091+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:01:01.121 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.121 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:01:01.197 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:01.194+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:01.259 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.259 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:01:01.298 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:01.295+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:01.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:01:01.398 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:01.394+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:01.438 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.438 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:01:01.499 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:01.495+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:01.600 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:01.598+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:01.615 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.615 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:01:01.701 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:01:01.695+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:01:01.792 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.792 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:01:01.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:01:01.807 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:01.802+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:01.902 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:01.898+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:01.938 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:01:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:01:01.941 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:01.941 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:01.955 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:01:01.955 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:01:01.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:01:01.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:01:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:01:01.989 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:01:01.989 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:01:02.003 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:01.999+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:02.007 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:01:02.007 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:01:02.025 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:01:02.025 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:01:02.042 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:01:02.043 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:01:02.062 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:01:02.062 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:01:02.077 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.077 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:02.078 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:02.078 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:02.078 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:02.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:01:02.134 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:02.131+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:02.185 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:01:02.205 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:02.202+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:02.274 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.274 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184288 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.385431195999999, 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090435267, 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184288 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888899+0000", 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888898+0000", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888901+0000", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0900000000000001e-06 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888910+0000", 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6899999999999998e-06 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888926+0000", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5573000000000002e-05 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979312+0000", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090386840999999996 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979334+0000", 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1662999999999999e-05 2024-09-21T14:01:02.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184289 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.385395966999994, 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090466201999999996, 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.279 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184289 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888934+0000", 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888933+0000", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888936+0000", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3799999999999998e-06 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888946+0000", 2024-09-21T14:01:02.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0033e-05 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888953+0000", 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7830000000000001e-06 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979387+0000", 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090434086999999996 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979400+0000", 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2832e-05 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184290 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.385370597999994, 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090521808999999995, 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.283 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184290 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888959+0000", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888962+0000", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.14e-06 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888970+0000", 2024-09-21T14:01:02.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3799999999999994e-06 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888977+0000", 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0369999999999997e-06 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979460+0000", 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090482332999999998 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979481+0000", 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1518999999999998e-05 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184291 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.385330056000001, 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090519410999999994, 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184291 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889000+0000", 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.888999+0000", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889003+0000", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8330000000000004e-06 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889012+0000", 2024-09-21T14:01:02.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2799999999999992e-06 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889019+0000", 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0530000000000001e-06 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979507+0000", 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090488061999999994 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979519+0000", 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2146e-05 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184292 3.e 3.c28d98ce (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.385289224000005, 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539643000000003, 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:02.291 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184292 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889041+0000", 2024-09-21T14:01:02.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889040+0000", 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889044+0000", 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5669999999999999e-06 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889053+0000", 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6260000000000007e-06 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.889060+0000", 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979558+0000", 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090498201 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.979580+0000", 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1902000000000001e-05 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:184629 3.e 3:7319b143:::rbd_data.118517a88f83.0000000000000003:1e [read 7659520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e76)", 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.276541803000001, 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090563626999999994, 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.295 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 184629 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997788+0000", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997791+0000", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997799+0000", 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3429999999999996e-06 2024-09-21T14:01:02.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:34.997809+0000", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9830000000000008e-06 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088222+0000", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090412760999999994 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088278+0000", 2024-09-21T14:01:02.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5863999999999999e-05 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:35.088352+0000", 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4035999999999994e-05 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:190491 3.1a 3:5b77ded8:::rbd_data.1185c72d2edc.0000000000000033:head [write 1802240~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:01:02.299 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.671078238000007, 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.78173297500000005, 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 190491 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603252+0000", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603251+0000", 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603261+0000", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603268+0000", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7469999999999999e-06 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603273+0000", 2024-09-21T14:01:02.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5379999999999996e-06 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603385+0000", 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112858 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:38.603412+0000", 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7041000000000001e-05 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.381836+0000", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.778423949 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382277+0000", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044070600000000002 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.382676+0000", 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039907499999999998 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384650+0000", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001973612 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384750+0000", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010048 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384884+0000", 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013350300000000001 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.384985+0000", 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100917 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206776 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1183744~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743592468000003, 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090540632999999995, 2024-09-21T14:01:02.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206776 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530737+0000", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530739+0000", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6899999999999999e-06 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530747+0000", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3559999999999993e-06 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530750+0000", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9950000000000001e-06 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.620985+0000", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090234412999999999 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621031+0000", 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5955000000000003e-05 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621278+0000", 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024754300000000003 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206777 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1228800~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.310 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743577273, 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090825530000000002, 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206777 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530753+0000", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530752+0000", 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530754+0000", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5400000000000001e-06 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530757+0000", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.179e-06 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530760+0000", 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.818e-06 2024-09-21T14:01:02.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621300+0000", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090539638000000006 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621344+0000", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4141999999999999e-05 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621578+0000", 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023443199999999999 2024-09-21T14:01:02.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206778 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1273856~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743567341000002, 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091124293999999995, 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206778 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530763+0000", 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530762+0000", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530764+0000", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.604e-06 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530767+0000", 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0060000000000001e-06 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530770+0000", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0699999999999998e-06 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621602+0000", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090832186999999995 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621652+0000", 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0005e-05 2024-09-21T14:01:02.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621887+0000", 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000234847 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206779 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1318912~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743557795000001, 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091380253999999994, 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.319 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206779 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:01:02.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530772+0000", 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530773+0000", 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4309999999999999e-06 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530777+0000", 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.146e-06 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530779+0000", 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.678e-06 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621910+0000", 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091131084000000001 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.621955+0000", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4675000000000002e-05 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622152+0000", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197445 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206780 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1363968~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:01:02.323 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743548473000004, 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091650489000000002, 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206780 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530781+0000", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530783+0000", 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.528e-06 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530787+0000", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2250000000000002e-06 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530790+0000", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.813e-06 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622175+0000", 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091385635000000007 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622218+0000", 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2728000000000002e-05 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622432+0000", 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021391199999999999 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206781 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1409024~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.743538224000005, 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091901387000000001, 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206781 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530792+0000", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967296 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530793+0000", 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.327e-06 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530796+0000", 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1939999999999998e-06 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530799+0000", 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3950000000000001e-06 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622466+0000", 2024-09-21T14:01:02.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091666048999999999 2024-09-21T14:01:02.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622527+0000", 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1268999999999999e-05 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622693+0000", 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166358 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206782 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1454080~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.742548094, 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091154847999999997, 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206782 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531782+0000", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.530801+0000", 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9990196 2024-09-21T14:01:02.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531786+0000", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00098486499999999992 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531795+0000", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0550000000000005e-06 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531800+0000", 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-09-21T14:01:02.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622721+0000", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090921162999999999 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622772+0000", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0155999999999999e-05 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622937+0000", 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165131 2024-09-21T14:01:02.338 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206783 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1499136~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.742517663000001, 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091396691000000002, 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206783 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.339 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531812+0000", 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531814+0000", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.182e-06 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531819+0000", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3009999999999997e-06 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531823+0000", 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2909999999999999e-06 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.622960+0000", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091137129999999997 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623003+0000", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3145000000000001e-05 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623209+0000", 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206073 2024-09-21T14:01:02.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206784 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1544192~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.742504564000001, 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091656136999999999, 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206784 2024-09-21T14:01:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531825+0000", 2024-09-21T14:01:02.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531827+0000", 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5039999999999999e-06 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531830+0000", 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.241e-06 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531833+0000", 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9610000000000001e-06 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623234+0000", 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091401246000000005 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623280+0000", 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5754999999999998e-05 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623482+0000", 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020167000000000001 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206785 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 1589248~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.742494727999997, 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091916872999999996, 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206785 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:01:02.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531835+0000", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531837+0000", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7749999999999999e-06 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531840+0000", 2024-09-21T14:01:02.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0740000000000001e-06 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.531843+0000", 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8090000000000001e-06 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623505+0000", 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.091662680999999996 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623549+0000", 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3612000000000002e-05 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.623752+0000", 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203263 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206795 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2039808~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.738391014000001, 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090634436999999998, 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206795 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535939+0000", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535941+0000", 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4569999999999999e-06 2024-09-21T14:01:02.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535948+0000", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1319999999999996e-06 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535953+0000", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1909999999999999e-06 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626328+0000", 2024-09-21T14:01:02.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090375132999999996 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626372+0000", 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3866000000000003e-05 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626573+0000", 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020103300000000001 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.355 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:206796 3.e 3:72c964e5:::rbd_data.118551b8ee3.0000000000000001:21 [read 2084864~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e89)", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 72.738372089999999, 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090932506999999996, 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 206796 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535958+0000", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535957+0000", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535960+0000", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4559999999999999e-06 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535966+0000", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.535972+0000", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626625+0000", 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.090652985000000005 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626681+0000", 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5983999999999998e-05 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:49.626890+0000", 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020987600000000001 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225600 3.14 3:2b03425b:::rbd_data.11853b23d9f4.0000000000000063:head [delete] snapc 25=[] ondisk+write+known_if_redirected+supports_pool_eio e123)", 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.805363243000002, 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20352477399999999, 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225600 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468967+0000", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468965+0000", 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468971+0000", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3720000000000001e-06 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468982+0000", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0696000000000001e-05 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.468990+0000", 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9729999999999997e-06 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469045+0000", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4812999999999998e-05 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469125+0000", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0054000000000003e-05 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 7", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.469242+0000", 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117038 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.470274+0000", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001031726 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672407+0000", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20213378800000001 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672453+0000", 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5461999999999999e-05 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:29.672491+0000", 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8686000000000002e-05 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.365 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:02.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:01:02.367 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:02.366+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:02.467 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:02.462+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:02.493 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.493 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:02.493 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:01:02.493 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:02.507 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:01:02.568 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:02.566+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:02.636 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.636 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:02.636 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:02.636 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:02.637 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:02.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:01:02.669 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:02.666+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:02.770 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:02.770+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:02.772 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.772 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289258219999994, 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:01:02.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:01:02.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289210112000006, 2024-09-21T14:01:02.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:01:02.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289147904000004, 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:01:02.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289099655000001, 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:01:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:01:02.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:01:02.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289054307000001, 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:01:02.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.289007854999994, 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:02.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288962076000004, 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:01:02.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:01:02.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288917018000006, 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.804 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:01:02.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288872558999998, 2024-09-21T14:01:02.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288820170999998, 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:01:02.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288787088000007, 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:01:02.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:02.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288702161000003, 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:01:02.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:01:02.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288655091999999, 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.826 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:01:02.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288609897000001, 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:02.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.834 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.288552292000006, 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:02.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.838 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.287116502999993, 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:01:02.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:01:02.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:01:02.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.287038382000006, 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:02.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 83.286989129999995, 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:02.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:01:02.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 69.976867170999995, 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:224424 3.4 3:2039325b:::rbd_data.1185ddc9253f.0000000000000006:head [stat,truncate 7405568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:01:02.857 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 41.077794885000003, 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49699188900000002, 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 224424 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693148+0000", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693155+0000", 2024-09-21T14:01:02.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5469999999999999e-06 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693175+0000", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.003e-05 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693190+0000", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4759999999999999e-05 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693346+0000", 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015559499999999999 2024-09-21T14:01:02.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693374+0000", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8577000000000001e-05 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.186889+0000", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49351429000000002 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187218+0000", 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000329394 2024-09-21T14:01:02.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187469+0000", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025103199999999999 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189826+0000", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023566400000000001 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189869+0000", 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3702999999999998e-05 2024-09-21T14:01:02.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189992+0000", 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122946 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.190141+0000", 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014868499999999999 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:02.863 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:02.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:01:02.910 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:02.907+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:02.971 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:02.966+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:02.992 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:02.992 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:02.992 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:01:02.992 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:03.007 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:01:03.098 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:01:03.095+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:01:03.173 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:01:03.167+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:01:03.174 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:03.175 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:03.175 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:03.175 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:03.175 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:03.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:01:03.274 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:03.274+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:03.362 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:03.362 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.485508786, 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.363 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:01:03.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:01:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.47763162300001, 2024-09-21T14:01:03.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:01:03.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.47369460100001, 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.372 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:03.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.473683392, 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.376 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:03.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.380 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.47367222, 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:03.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:01:03.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.473657917, 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:01:03.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.473622457, 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:01:03.393 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.473609294, 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.394 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:01:03.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:01:03.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.47359776299999, 2024-09-21T14:01:03.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:01:03.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.469609795, 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:01:03.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.46959016299999, 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.407 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:01:03.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.469565335, 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:01:03.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:01:03.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.469540338, 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:01:03.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.469528268, 2024-09-21T14:01:03.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:01:03.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.46951694800001, 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:03.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.46950580699999, 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:03.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:01:03.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:01:03.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:03.433 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.46949350599999, 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:01:03.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:01:03.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 136.46948225400001, 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:03.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:01:03.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:01:03.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.39341250199999, 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.442 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:01:03.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:01:03.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 134.38418592599999, 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:01:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.452 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:03.453 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:01:03.454 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:03.447+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:03.554 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:03.551+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:03.628 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:03.629 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:01:03.629 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:03.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:01:03.686 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:03.683+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:03.755 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:03.751+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:03.802 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:03.803 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:03.803 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:03.803 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:03.803 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:03.817 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:01:03.856 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:03.854+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:03.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:03.954+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.469190514999994, 2024-09-21T14:01:03.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:01:03.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.469122729999995, 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:03.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:03.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:03.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 64.469088357000004, 2024-09-21T14:01:03.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:01:03.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:03.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:04.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.830284558000002, 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:01:04.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:01:04.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:01:04.008 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.786011170999998, 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:01:04.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:01:04.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.678658763999998, 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:01:04.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:04.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.677662538, 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:01:04.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:01:04.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:01:04.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.028 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.677629734999996, 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:01:04.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:04.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:04.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.676736536, 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.266068291000003, 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:01:04.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:01:04.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225656 3.f 3:f06e83f4:::rbd_header.1185becdc07b:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.622476796999997, 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012824129, 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225656 2024-09-21T14:01:04.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364261+0000", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364280+0000", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8294000000000001e-05 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364322+0000", 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2765999999999997e-05 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364346+0000", 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.421e-05 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364481+0000", 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013467500000000001 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:01:04.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364493+0000", 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1737e-05 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.371885+0000", 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073922550000000004 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.372324+0000", 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043909 2024-09-21T14:01:04.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.373143+0000", 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081840700000000005 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376653+0000", 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035104120000000001 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376838+0000", 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000184709 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376984+0000", 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014582899999999999 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.377089+0000", 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010527900000000001 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(osd.7.0:293 3.15 e138/99 ondisk, result = 0)", 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.495000757, 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011962766999999999, 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491741+0000", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491739+0000", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491749+0000", 2024-09-21T14:01:04.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5899999999999997e-06 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491774+0000", 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4987e-05 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.491791+0000", 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6915999999999999e-05 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503491+0000", 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011700293 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503510+0000", 2024-09-21T14:01:04.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8677000000000001e-05 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:45.503704+0000", 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019375100000000001 2024-09-21T14:01:04.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229160 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch reconnect cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.790510299999999, 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.051632057, 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229160 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196230+0000", 2024-09-21T14:01:04.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196237+0000", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196261+0000", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4292000000000001e-05 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196273+0000", 2024-09-21T14:01:04.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1178999999999999e-05 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196398+0000", 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012588700000000001 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196431+0000", 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999997e-05 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246497+0000", 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0500661099999999 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246589+0000", 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1217000000000004e-05 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247840+0000", 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001251895 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247863+0000", 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2855000000000001e-05 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229161 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch ping cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.789312989999999, 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050481878000000001, 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229161 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197425+0000", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197443+0000", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8499999999999999e-05 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197487+0000", 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3408999999999997e-05 2024-09-21T14:01:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197512+0000", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5412999999999999e-05 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197595+0000", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2562e-05 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197609+0000", 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4405e-05 2024-09-21T14:01:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246620+0000", 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049010552999999998 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246729+0000", 2024-09-21T14:01:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108902 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247897+0000", 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001168627 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247910+0000", 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3193000000000001e-05 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.18 144/143 [PushOp(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e, version: 50'171, data_included: [38912~40960,159744~34816,362496~2048,366592~2048,372736~2048,376832~2048,382976~2048,387072~2048,393216~2048,397312~2048,401408~22528], data_size: 114688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e@50'171, size: 423936, copy_subset: [0~423936], clone_subset: {}, snapset: e=[]:{e=[e]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:423936, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.652614476, 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016137994999999999, 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334126+0000", 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334244+0000", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118025 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334257+0000", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2165e-05 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334268+0000", 2024-09-21T14:01:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1275e-05 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334327+0000", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9472000000000003e-05 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334335+0000", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4889999999999998e-06 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350265+0000", 2024-09-21T14:01:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015930257 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPushReply(3.7 144/143 [PushReplyOp(3:e3b9eed5:::rbd_data.1185ba4f1d0d.0000000000000021:12)])", 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.651939071999999, 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015399133000000001, 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334806+0000", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0319999999999997e-06 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334813+0000", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.041e-06 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334818+0000", 2024-09-21T14:01:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.566e-06 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334860+0000", 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2330000000000003e-05 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350202+0000", 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015341662000000001 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229552 3.e 3:77344450:::rbd_object_map.1185ba4f1d0d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.733629274, 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018807949000000001, 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229552 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253108+0000", 2024-09-21T14:01:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253129+0000", 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0069999999999999e-05 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253174+0000", 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.507e-05 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253196+0000", 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-05 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253329+0000", 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013327599999999999 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253560+0000", 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023107100000000001 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.254034+0000", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047362400000000002 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.255788+0000", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017547769999999999 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271806+0000", 2024-09-21T14:01:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01601735 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271866+0000", 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0056000000000002e-05 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271920+0000", 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4419000000000002e-05 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2969 3.12 e153/117 3:4e9dc24d:::rbd_data.1185cd54b1ab.0000000000000001:c v 153'981, mlcod=152'978)", 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7112145129999998, 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023706353999999999, 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275534+0000", 2024-09-21T14:01:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.52e-06 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275559+0000", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4691000000000001e-05 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275570+0000", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1031e-05 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275713+0000", 2024-09-21T14:01:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014284200000000001 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275744+0000", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0916e-05 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299134+0000", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023389969 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299233+0000", 2024-09-21T14:01:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9698999999999995e-05 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2971 3.12 e153/117 3:4ed65898:::rbd_data.1185cd54b1ab.0000000000000005:c v 153'983, mlcod=152'978)", 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7046658880000001, 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017367852999999999, 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282074+0000", 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282087+0000", 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2891000000000001e-05 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282102+0000", 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4834000000000001e-05 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282112+0000", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5619999999999993e-06 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288501+0000", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063891599999999996 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288551+0000", 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0049000000000001e-05 2024-09-21T14:01:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299408+0000", 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010856872 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299444+0000", 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5941e-05 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:231250 3.7 e157/148 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head v 157'680, mlcod=156'674)", 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.66036668600000004, 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012995352, 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326374+0000", 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326385+0000", 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1746000000000001e-05 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326407+0000", 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1333000000000001e-05 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326822+0000", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00041486700000000002 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.328644+0000", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018222170000000001 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.328692+0000", 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7923999999999997e-05 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.339331+0000", 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010639103 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.339370+0000", 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9418000000000001e-05 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:04.105 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:04.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-21T14:01:04.107 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:04.103+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:04.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-21T14:01:04.208 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:04.206+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:04.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:01:04.233 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:04.233 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-21T14:01:04.233 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-21T14:01:04.233 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:04.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-21T14:01:04.264 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:01:04.264 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:01:04.283 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:01:04.283 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:01:04.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:01:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:01:04.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:04.306+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:04.321 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:01:04.322 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:01:04.346 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:01:04.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:01:04.371 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:01:04.371 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:01:04.386 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:04.386 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:04.395 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:01:04.396 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:01:04.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-21T14:01:04.418 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:01:04.419 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:01:04.419 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:04.414+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:04.511 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:04.507+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:04.536 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:04.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-21T14:01:04.612 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:04.610+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:04.674 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:04.674 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:04.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-21T14:01:04.713 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:04.707+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:04.762 INFO:tasks.thrashosds.thrasher:in_osds: [4, 5, 6, 7, 1, 2, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-21T14:01:04.763 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-21T14:01:04.763 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-21T14:01:04.763 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-21T14:01:04.824 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:04.822+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:04.855 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:04.856 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:04.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-21T14:01:04.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-21T14:01:04.938 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:04.934+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:05.024 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.024 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:05.022+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:05.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-21T14:01:05.117 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:05.111+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:05.158 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-21T14:01:05.204 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.205 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.218 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:05.215+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:05.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-21T14:01:05.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-21T14:01:05.319 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:05.315+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:05.321 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:01:05.391 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.391 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-21T14:01:05.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:05.446+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:05.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-21T14:01:05.520 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:05.515+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:05.562 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.562 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-21T14:01:05.621 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:05.619+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:05.684 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-21T14:01:05.721 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:05.715+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:05.737 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.737 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-21T14:01:05.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:05.818+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:05.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-21T14:01:05.861 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:05.861 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:05.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-21T14:01:05.923 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:05.919+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:06.024 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:06.022+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:06.027 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:06.027 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:06.039 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-21T14:01:06.125 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-21T14:01:06.122+0000 7f950c25b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26310) UID: 0 2024-09-21T14:01:06.171 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:06.171 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:06.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-21T14:01:06.230 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:06.227+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:06.308 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:06.309 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:06.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-21T14:01:06.366 INFO:tasks.ceph.osd.7.smithi134.stderr:2024-09-21T14:01:06.367+0000 7f742d113640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 35993) UID: 0 2024-09-21T14:01:06.427 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:06.422+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:06.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-21T14:01:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:06.497 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:06.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-21T14:01:06.527 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:06.522+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:06.593 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-21T14:01:06.594 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-21T14:01:06.611 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-21T14:01:06.611 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-21T14:01:06.630 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-21T14:01:06.630 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-21T14:01:06.630 INFO:tasks.ceph.osd.4.smithi134.stderr:2024-09-21T14:01:06.623+0000 7f9c98b65640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26366) UID: 0 2024-09-21T14:01:06.637 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-09-21T14:01:06.637 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-21T14:01:06.645 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-21T14:01:06.645 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-21T14:01:06.652 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-21T14:01:06.664 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-21T14:01:06.665 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-21T14:01:06.683 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-21T14:01:06.684 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-21T14:01:06.701 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-21T14:01:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-21T14:01:06.720 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-21T14:01:06.720 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-21T14:01:06.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-21T14:01:06.726+0000 7fd6b56d0640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26306) UID: 0 2024-09-21T14:01:06.820 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:06.821 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:06.829 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:06.823+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:06.835 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-21T14:01:06.930 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-21T14:01:06.926+0000 7f1e253cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26304) UID: 0 2024-09-21T14:01:07.004 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.004 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:07.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:07.004 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191272 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10821632~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520425501000005, 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082691517000000006, 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191272 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481686+0000", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481685+0000", 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:07.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481691+0000", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7530000000000004e-06 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481709+0000", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7312999999999998e-05 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481722+0000", 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3709e-05 2024-09-21T14:01:07.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564142+0000", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082419361999999996 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564267+0000", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012510599999999999 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564377+0000", 2024-09-21T14:01:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011047100000000001 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191273 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10862592~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520377393000004, 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082789044000000006, 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.009 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191273 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481734+0000", 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481733+0000", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481752+0000", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8992999999999999e-05 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481770+0000", 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7978999999999998e-05 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481784+0000", 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.413e-05 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564412+0000", 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082627920999999993 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564456+0000", 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4354000000000003e-05 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564523+0000", 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6790000000000003e-05 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191274 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10903552~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520315185000001, 2024-09-21T14:01:07.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082969107, 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191274 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481796+0000", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481795+0000", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481801+0000", 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3369999999999996e-06 2024-09-21T14:01:07.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481819+0000", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7146000000000002e-05 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481832+0000", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.31e-05 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564568+0000", 2024-09-21T14:01:07.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082736868000000005 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564652+0000", 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3710999999999999e-05 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564765+0000", 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113082 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191275 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10944512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520266935999999, 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083068113999999998, 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191275 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481844+0000", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481843+0000", 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481849+0000", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9730000000000002e-06 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481866+0000", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.632e-05 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481878+0000", 2024-09-21T14:01:07.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.269e-05 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564805+0000", 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.082927038999999994 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564857+0000", 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2098000000000002e-05 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564913+0000", 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5140999999999999e-05 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191276 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 10985472~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520221587999998, 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083267082000000006, 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191276 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481890+0000", 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481889+0000", 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481894+0000", 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3800000000000002e-06 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481911+0000", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6813e-05 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481924+0000", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2696e-05 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.564952+0000", 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083028016999999996 2024-09-21T14:01:07.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565055+0000", 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103065 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565157+0000", 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101974 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191277 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11026432~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520175136000006, 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083469613999999998, 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191277 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481936+0000", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481935+0000", 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481941+0000", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6300000000000003e-06 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481958+0000", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6762e-05 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481971+0000", 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3200000000000001e-05 2024-09-21T14:01:07.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565199+0000", 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083228430000000006 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565302+0000", 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102713 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565406+0000", 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103745 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191278 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11067392~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520129357000002, 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083616852000000005, 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.031 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191278 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481982+0000", 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481981+0000", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.481987+0000", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7790000000000001e-06 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482003+0000", 2024-09-21T14:01:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6609999999999999e-05 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482016+0000", 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2660000000000001e-05 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565447+0000", 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083430675999999995 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565497+0000", 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0812000000000001e-05 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565599+0000", 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101375 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191279 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11108352~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520084299000004, 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083804997000000006, 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191279 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482027+0000", 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482026+0000", 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482032+0000", 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7130000000000002e-06 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482048+0000", 2024-09-21T14:01:07.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6076e-05 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482061+0000", 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2957e-05 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565642+0000", 2024-09-21T14:01:07.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083580958999999996 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565732+0000", 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0605000000000004e-05 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565832+0000", 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9649999999999996e-05 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191280 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11149312~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.520039839999995, 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083975223000000002, 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191280 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482072+0000", 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482070+0000", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482077+0000", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1160000000000004e-06 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482093+0000", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482111+0000", 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8643000000000001e-05 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565869+0000", 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083757779000000004 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.565945+0000", 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6445000000000004e-05 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566047+0000", 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010136000000000001 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191281 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11190272~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519987451999995, 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084156423999999994, 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191281 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482124+0000", 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482123+0000", 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482129+0000", 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7969999999999997e-06 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482143+0000", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4343e-05 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482151+0000", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4429999999999997e-06 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566092+0000", 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083941103000000003 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566180+0000", 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8740999999999996e-05 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566280+0000", 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9866999999999998e-05 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191282 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11231232~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519954369000004, 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084264188000000004, 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191282 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:07.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482157+0000", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482156+0000", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482161+0000", 2024-09-21T14:01:07.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6e-06 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482176+0000", 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482188+0000", 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.205e-05 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566320+0000", 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084131935000000005 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566366+0000", 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5895e-05 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566421+0000", 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5529000000000003e-05 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191283 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11272192~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519869442000001, 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084326421999999998, 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191283 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482242+0000", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482241+0000", 2024-09-21T14:01:07.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482247+0000", 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3990000000000001e-06 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482264+0000", 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.681e-05 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482277+0000", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346000000000001e-05 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566456+0000", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084179005000000001 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566514+0000", 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8173e-05 2024-09-21T14:01:07.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566568+0000", 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3952000000000001e-05 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191284 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11313152~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519822372999997, 2024-09-21T14:01:07.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084403952000000004, 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191284 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482289+0000", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482288+0000", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482293+0000", 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4439999999999999e-06 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482310+0000", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6175999999999999e-05 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482323+0000", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2993000000000001e-05 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566595+0000", 2024-09-21T14:01:07.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084272706000000003 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566639+0000", 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4152e-05 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566693+0000", 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3514999999999998e-05 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191285 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11354112~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519777177999998, 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084484089999999998, 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191285 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482334+0000", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482333+0000", 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482350+0000", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6786000000000002e-05 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482367+0000", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7045999999999999e-05 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482380+0000", 2024-09-21T14:01:07.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3166000000000001e-05 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566726+0000", 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084345378999999998 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566769+0000", 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3374000000000002e-05 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566818+0000", 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9361999999999999e-05 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191286 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11395072~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.519719573000003, 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084545031000000007, 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191286 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482392+0000", 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482391+0000", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482396+0000", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.75e-06 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482413+0000", 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6429000000000001e-05 2024-09-21T14:01:07.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482426+0000", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3327e-05 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566846+0000", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.084419547999999997 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566887+0000", 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0958999999999999e-05 2024-09-21T14:01:07.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566937+0000", 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0145000000000002e-05 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191287 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11436032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.518283784000005, 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083229751000000005, 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191287 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483828+0000", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.482437+0000", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9986091 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483843+0000", 2024-09-21T14:01:07.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001406603 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483870+0000", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6469e-05 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483888+0000", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8715999999999998e-05 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.566964+0000", 2024-09-21T14:01:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083076099 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567007+0000", 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2311000000000002e-05 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567057+0000", 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0562999999999997e-05 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191288 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11476992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.518205663000003, 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083268536000000004, 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191288 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483906+0000", 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483904+0000", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483912+0000", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2760000000000003e-06 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483929+0000", 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483943+0000", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3409e-05 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567083+0000", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083140644999999999 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567125+0000", 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1329999999999999e-05 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567174+0000", 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9645999999999999e-05 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:191289 3.1d 3:b8721e24:::rbd_data.118517a88f83.0000000000000000:1e [read 11517952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 87.518156411000007, 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083367384000000003, 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191289 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483955+0000", 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483954+0000", 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483960+0000", 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.533e-06 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483977+0000", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6966e-05 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.483996+0000", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8283000000000001e-05 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567211+0000", 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.083215240999999995 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567268+0000", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6959000000000001e-05 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:39.567322+0000", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4622e-05 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:213279 3.5 3:a33be464:::rbd_data.11853179fc0d.000000000000006c:head [write 425984~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 74.208034452000007, 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.207737382, 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 213279 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794077+0000", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794076+0000", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794096+0000", 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0526e-05 2024-09-21T14:01:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794123+0000", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6287000000000001e-05 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.794140+0000", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7549000000000001e-05 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796159+0000", 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020184579999999999 2024-09-21T14:01:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796289+0000", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130154 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 3", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.796652+0000", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036330800000000001 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:52.798404+0000", 2024-09-21T14:01:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017515670000000001 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001677+0000", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.20327319299999999 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001759+0000", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1904999999999996e-05 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:53.001814+0000", 2024-09-21T14:01:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5482000000000002e-05 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:224424 3.4 3:2039325b:::rbd_data.1185ddc9253f.0000000000000006:head [stat,truncate 7405568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115)", 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.308962166000001, 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49699188900000002, 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 224424 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693149+0000", 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693148+0000", 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693155+0000", 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5469999999999999e-06 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693175+0000", 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.003e-05 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693190+0000", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4759999999999999e-05 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693346+0000", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015559499999999999 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:21.693374+0000", 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8577000000000001e-05 2024-09-21T14:01:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.186889+0000", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.49351429000000002 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187218+0000", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000329394 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.187469+0000", 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025103199999999999 2024-09-21T14:01:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189826+0000", 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023566400000000001 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189869+0000", 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3702999999999998e-05 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.189992+0000", 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122946 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:22.190141+0000", 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014868499999999999 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.098 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.100 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-21T14:01:07.100 INFO:tasks.ceph.osd.5.smithi134.stderr:2024-09-21T14:01:07.099+0000 7f42c04e2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26367) UID: 0 2024-09-21T14:01:07.201 INFO:tasks.ceph.osd.6.smithi134.stderr:2024-09-21T14:01:07.195+0000 7f53eeda9640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26370) UID: 0 2024-09-21T14:01:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.284 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:07.284 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:01:07.284 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.300 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-21T14:01:07.302 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:07.298+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:07.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-21T14:01:07.365 INFO:teuthology.orchestra.run.smithi079.stdout:All operations completed A-OK! 2024-09-21T14:01:07.403 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-21T14:01:07.398+0000 7f85c99c3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26308) UID: 0 2024-09-21T14:01:07.430 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:07.431 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-21T14:01:07.446 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-21T14:01:07.455 INFO:tasks.thrashosds:joining thrashosds 2024-09-21T14:01:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:07.465 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:07.465 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-21T14:01:07.604 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48142 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12824576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.72686281700001, 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072848998999999998, 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.605 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48142 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876064+0000", 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876066+0000", 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.745e-06 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876069+0000", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7280000000000001e-06 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.876073+0000", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948588+0000", 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072515046 2024-09-21T14:01:07.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948760+0000", 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000172416 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.948913+0000", 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000153189 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48171 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13084672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71898565399999, 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072953772, 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48171 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883941+0000", 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883943+0000", 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6610000000000001e-06 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883946+0000", 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6689999999999999e-06 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.883950+0000", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.348e-06 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956598+0000", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072647860999999994 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956747+0000", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000149429 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.956895+0000", 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014807700000000001 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48185 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12679168~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71504863199999, 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072658594000000007, 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48185 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887878+0000", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887880+0000", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6640000000000001e-06 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887884+0000", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7529999999999999e-06 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887887+0000", 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.208e-06 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960239+0000", 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072351821999999996 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960388+0000", 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014948300000000001 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960537+0000", 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014892799999999999 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48187 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12695552~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71503742300001, 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072988223000000005, 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48187 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887890+0000", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887889+0000", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887891+0000", 2024-09-21T14:01:07.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.601e-06 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887895+0000", 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6729999999999998e-06 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887898+0000", 2024-09-21T14:01:07.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960590+0000", 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072692042999999998 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960730+0000", 2024-09-21T14:01:07.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013966099999999999 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960878+0000", 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014823899999999999 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48189 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12711936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71502625100001, 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073311459999999995, 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.627 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48189 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887901+0000", 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887900+0000", 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887902+0000", 2024-09-21T14:01:07.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.573e-06 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887906+0000", 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8179999999999997e-06 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887912+0000", 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8830000000000003e-06 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.960935+0000", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073023498000000006 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961068+0000", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013317099999999999 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961212+0000", 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014378500000000001 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48191 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12728320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71501194800001, 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073514876000000007, 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48191 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887915+0000", 2024-09-21T14:01:07.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887920+0000", 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887924+0000", 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9609999999999999e-06 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887927+0000", 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5429999999999998e-06 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961274+0000", 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073346620000000001 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961355+0000", 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1144999999999996e-05 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961430+0000", 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4907999999999995e-05 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48193 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12744704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71497648799999, 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073705564000000001, 2024-09-21T14:01:07.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48193 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887951+0000", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887950+0000", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887952+0000", 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.84e-06 2024-09-21T14:01:07.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887956+0000", 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.194e-06 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887960+0000", 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4209999999999999e-06 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961478+0000", 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073518436000000006 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961582+0000", 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010370300000000001 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961656+0000", 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4283999999999996e-05 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48195 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12761088~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71496332500001, 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073977385000000007, 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48195 2024-09-21T14:01:07.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887964+0000", 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887963+0000", 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887965+0000", 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6479999999999999e-06 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887969+0000", 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9779999999999999e-06 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887972+0000", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961702+0000", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073729843000000003 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961795+0000", 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2369999999999998e-05 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.961941+0000", 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014654699999999999 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48197 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12777472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.714951794, 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074307974999999998, 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.645 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48197 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:07.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887975+0000", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887977+0000", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.689e-06 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887980+0000", 2024-09-21T14:01:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7050000000000001e-06 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.887983+0000", 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.083e-06 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962021+0000", 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074037218000000002 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962161+0000", 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014016300000000001 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.962283+0000", 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012238700000000001 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48215 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12924928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:07.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71096382600001, 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072729100000000005, 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48215 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891963+0000", 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891970+0000", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5660000000000001e-06 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891975+0000", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2919999999999997e-06 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891979+0000", 2024-09-21T14:01:07.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8759999999999998e-06 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964421+0000", 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072442512000000001 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964577+0000", 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156038 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964692+0000", 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011508 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48217 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12941312~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71094419400001, 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072839863000000005, 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.657 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48217 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891983+0000", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891984+0000", 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.607e-06 2024-09-21T14:01:07.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891990+0000", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7690000000000002e-06 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.891993+0000", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5949999999999999e-06 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964722+0000", 2024-09-21T14:01:07.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072728928999999998 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964775+0000", 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2299999999999997e-05 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964823+0000", 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7954999999999997e-05 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48219 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12957696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71091936600001, 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072940457, 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48219 2024-09-21T14:01:07.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892008+0000", 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892007+0000", 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892010+0000", 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5569999999999998e-06 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892014+0000", 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5140000000000003e-06 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892018+0000", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5889999999999999e-06 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964842+0000", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072824009999999995 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964886+0000", 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4381000000000001e-05 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964948+0000", 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2050000000000004e-05 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48221 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12974080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71089436899999, 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073121197999999998, 2024-09-21T14:01:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48221 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892033+0000", 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892032+0000", 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892034+0000", 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.832e-06 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892038+0000", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892042+0000", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4369999999999999e-06 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.964981+0000", 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.072939484999999998 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965067+0000", 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5748000000000006e-05 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965154+0000", 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6842000000000006e-05 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48223 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 12990464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71088229899999, 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073489261, 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48223 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892045+0000", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892044+0000", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892046+0000", 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6789999999999999e-06 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892050+0000", 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892053+0000", 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1599999999999998e-06 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965224+0000", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073170658 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965367+0000", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014339299999999999 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965534+0000", 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000166775 2024-09-21T14:01:07.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48225 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13006848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71087097899999, 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073852797999999997, 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48225 2024-09-21T14:01:07.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892056+0000", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892057+0000", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.561e-06 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892061+0000", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.715e-06 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892064+0000", 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1470000000000001e-06 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965595+0000", 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073530439000000003 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965758+0000", 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000163695 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965909+0000", 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150507 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48227 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13023232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.710859838, 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074178480000000005, 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48227 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892067+0000", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892068+0000", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.75e-06 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892072+0000", 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7500000000000001e-06 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892075+0000", 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2669999999999998e-06 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.965963+0000", 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073887491 2024-09-21T14:01:07.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966144+0000", 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181366 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966246+0000", 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101306 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48229 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13039616~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.71084753700001, 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074418644000000006, 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48229 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892079+0000", 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892081+0000", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.55e-06 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892085+0000", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8240000000000001e-06 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892088+0000", 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2399999999999999e-06 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966280+0000", 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074191727999999998 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966399+0000", 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011944500000000001 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966498+0000", 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9122000000000004e-05 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:48231 3.a 3:503b2916:::rbd_data.11853c86949e.0000000000000005:a [read 13056000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 140.710836285, 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074659564999999997, 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:07.688 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 48231 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892091+0000", 2024-09-21T14:01:07.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892090+0000", 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892092+0000", 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6530000000000001e-06 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892096+0000", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.817e-06 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.892099+0000", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.275e-06 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966534+0000", 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074434680000000003 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966634+0000", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9769e-05 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:46.966750+0000", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011663399999999999 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:72549 3.a 3:542480bc:::rbd_data.1185cd54b1ab.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,zero 6815744~524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:07.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 138.634766533, 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.080642710000000006, 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 72549 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968160+0000", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.968158+0000", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981911+0000", 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013753250999999999 2024-09-21T14:01:07.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981941+0000", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9476e-05 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.981957+0000", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6557000000000001e-05 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982042+0000", 2024-09-21T14:01:07.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4534000000000001e-05 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982325+0000", 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028338700000000002 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.982806+0000", 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048059200000000001 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:07.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.037853+0000", 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055047681000000001 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048694+0000", 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01084098 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048760+0000", 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5335999999999999e-05 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.048803+0000", 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3405999999999997e-05 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:72544 3.1e e45/23 3:7edc8795:::rbd_data.1185cd54b1ab.0000000000000007:head v 45'69, mlcod=40'66)", 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 138.625539957, 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074304485000000003, 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:07.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977387+0000", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.977385+0000", 2024-09-21T14:01:07.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998030+0000", 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020644518000000001 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998100+0000", 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0128000000000003e-05 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998128+0000", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7851000000000002e-05 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998187+0000", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9197000000000003e-05 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:48.998217+0000", 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0009e-05 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051595+0000", 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.053377604000000002 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:58:49.051692+0000", 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6892999999999995e-05 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:07.702 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.704 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-21T14:01:07.828 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.828 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:07.828 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-09-21T14:01:07.828 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.842 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-21T14:01:07.967 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-09-21T14:01:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-09-21T14:01:07.967 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-09-21T14:01:07.967 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:07.982 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219172 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:08.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.583169388000002, 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0068365969999999, 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219172 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517551+0000", 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517549+0000", 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517561+0000", 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1474000000000001e-05 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517581+0000", 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0143999999999999e-05 2024-09-21T14:01:08.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517596+0000", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5143999999999999e-05 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517981+0000", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038496800000000002 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517998+0000", 2024-09-21T14:01:08.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6861999999999999e-05 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524338+0000", 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0063402990000001 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524388+0000", 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9419999999999998e-05 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219173 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.583101603000003, 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.00703966, 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219173 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517619+0000", 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517618+0000", 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517625+0000", 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6150000000000002e-06 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517636+0000", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1501999999999999e-05 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517645+0000", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2359999999999993e-06 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518026+0000", 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000380894 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518032+0000", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524631+0000", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006598265 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524658+0000", 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7739999999999999e-05 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.113 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219174 3.f 3.2fc1760f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 68.583067229999997, 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0070932829999999, 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.114 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219174 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517653+0000", 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517657+0000", 2024-09-21T14:01:08.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3470000000000001e-06 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517666+0000", 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1740000000000006e-06 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.517674+0000", 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9629999999999998e-06 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518064+0000", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038981999999999998 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T13:59:59.518070+0000", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1569999999999997e-06 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524721+0000", 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.006650646 2024-09-21T14:01:08.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524746+0000", 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5826e-05 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219175 3.f 3.2fc1760f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e94)", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.944263430999996, 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36837532000000001, 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219175 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:08.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156457+0000", 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156454+0000", 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999976 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156467+0000", 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2415999999999999e-05 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156491+0000", 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4541000000000001e-05 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156506+0000", 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4861000000000001e-05 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156587+0000", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1075999999999994e-05 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.156604+0000", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6616000000000002e-05 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524805+0000", 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.36820145700000001 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:00.524832+0000", 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6889999999999998e-05 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219683 3.f 3:f314c345:::rbd_data.11853b23d9f4.0000000000000053:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.899990043999999, 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012684822, 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.124 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219683 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200730+0000", 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200728+0000", 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200746+0000", 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8369999999999999e-05 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200790+0000", 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200813+0000", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2963999999999999e-05 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.200930+0000", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011710900000000001 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.201673+0000", 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074297800000000004 2024-09-21T14:01:08.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.203570+0000", 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018969290000000001 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213195+0000", 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096253629999999996 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213215+0000", 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9916999999999999e-05 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213298+0000", 2024-09-21T14:01:08.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3273e-05 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:06.213415+0000", 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116803 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219983 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.792637636999999, 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013573633, 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219983 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308083+0000", 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308082+0000", 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308086+0000", 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.279e-06 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308092+0000", 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0410000000000003e-06 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.308096+0000", 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4340000000000001e-06 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313007+0000", 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049112060000000004 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313152+0000", 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145236 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.313876+0000", 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00072368499999999995 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319540+0000", 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056640520000000001 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321484+0000", 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019434980000000001 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321554+0000", 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0698999999999995e-05 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321656+0000", 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010218899999999999 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219985 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:08.139 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.791641411000001, 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013528617999999999, 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219985 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309079+0000", 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309078+0000", 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309083+0000", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0819999999999998e-06 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309098+0000", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4610000000000001e-05 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309105+0000", 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5410000000000003e-06 2024-09-21T14:01:08.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315599+0000", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064940930000000003 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.315790+0000", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190268 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.316713+0000", 2024-09-21T14:01:08.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092341400000000001 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.321719+0000", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005005799 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322445+0000", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000726394 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322568+0000", 2024-09-21T14:01:08.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000123013 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322608+0000", 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9276999999999997e-05 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219987 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.791608607999997, 2024-09-21T14:01:08.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013700034, 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219987 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:08.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309112+0000", 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309111+0000", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309114+0000", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-06 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309118+0000", 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.532e-06 2024-09-21T14:01:08.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.309122+0000", 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4419999999999998e-06 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.317842+0000", 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087207269999999993 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318053+0000", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021096799999999999 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.318507+0000", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045317000000000003 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322616+0000", 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041092250000000002 2024-09-21T14:01:08.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322722+0000", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106648 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322768+0000", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5469000000000001e-05 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.322812+0000", 2024-09-21T14:01:08.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3976e-05 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:219989 3.d 3:b333fdbb:::rbd_object_map.11853b23d9f4.0000000000000025:head [call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.790715409000001, 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015929784999999998, 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 219989 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310005+0000", 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310003+0000", 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310016+0000", 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2449999999999999e-05 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310047+0000", 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1652999999999997e-05 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.310061+0000", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3467e-05 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319606+0000", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095451289999999994 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.319838+0000", 2024-09-21T14:01:08.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231752 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 5", 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.320765+0000", 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00092756999999999996 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.323128+0000", 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002362346 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325754+0000", 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026260490000000001 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325855+0000", 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101486 2024-09-21T14:01:08.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.325935+0000", 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9746000000000005e-05 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:220184 3.f 3:f2a565e3:::rbd_data.118525f806ac.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.380047163999997, 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017465604999999999, 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 220184 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720673+0000", 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720672+0000", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720886+0000", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000213988 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720902+0000", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6353000000000001e-05 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720910+0000", 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8040000000000002e-06 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.720975+0000", 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4986000000000004e-05 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.721195+0000", 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000219748 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.724029+0000", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028336049999999999 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737948+0000", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013919841000000001 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.737967+0000", 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9128e-05 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738059+0000", 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1642000000000001e-05 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:07.738139+0000", 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9742999999999999e-05 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.164 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:225656 3.f 3:f06e83f4:::rbd_header.1185becdc07b:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124)", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 37.736455669999998, 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012824129, 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 225656 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364265+0000", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364261+0000", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364280+0000", 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8294000000000001e-05 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364322+0000", 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2765999999999997e-05 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364346+0000", 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.421e-05 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364481+0000", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013467500000000001 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.364493+0000", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1737e-05 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.371885+0000", 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073922550000000004 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.372324+0000", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043909 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.373143+0000", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00081840700000000005 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376653+0000", 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035104120000000001 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376838+0000", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000184709 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.376984+0000", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014582899999999999 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:30.377089+0000", 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010527900000000001 2024-09-21T14:01:08.170 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229160 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch reconnect cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.904489173000002, 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.051632057, 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229160 2024-09-21T14:01:08.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196231+0000", 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196230+0000", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196237+0000", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5360000000000004e-06 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196261+0000", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4292000000000001e-05 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196273+0000", 2024-09-21T14:01:08.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1178999999999999e-05 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196398+0000", 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012588700000000001 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:49.196431+0000", 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2839999999999997e-05 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246497+0000", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0500661099999999 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246589+0000", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1217000000000004e-05 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247840+0000", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001251895 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247863+0000", 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2855000000000001e-05 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229161 3.8 3:15f8e404:::rbd_header.118582a24297:head [watch ping cookie 140594346707520 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e143)", 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.903291863, 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.050481878000000001, 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.176 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229161 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197429+0000", 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197425+0000", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197443+0000", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8499999999999999e-05 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197487+0000", 2024-09-21T14:01:08.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3408999999999997e-05 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197512+0000", 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5412999999999999e-05 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197595+0000", 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2562e-05 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-09-21T14:01:08.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.197609+0000", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4405e-05 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246620+0000", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.049010552999999998 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for rw locks", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.246729+0000", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108902 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247897+0000", 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001168627 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.247910+0000", 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3193000000000001e-05 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPush(3.18 144/143 [PushOp(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e, version: 50'171, data_included: [38912~40960,159744~34816,362496~2048,366592~2048,372736~2048,376832~2048,382976~2048,387072~2048,393216~2048,397312~2048,401408~22528], data_size: 114688, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:1bc70739:::rbd_data.118591b65b05.0000000000000026:e@50'171, size: 423936, copy_subset: [0~423936], clone_subset: {}, snapset: e=[]:{e=[e]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:423936, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.766593349000001, 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016137994999999999, 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:08.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334127+0000", 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334126+0000", 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334244+0000", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118025 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334257+0000", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2165e-05 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334268+0000", 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1275e-05 2024-09-21T14:01:08.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334327+0000", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9472000000000003e-05 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334335+0000", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4889999999999998e-06 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350265+0000", 2024-09-21T14:01:08.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015930257 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "MOSDPGPushReply(3.7 144/143 [PushReplyOp(3:e3b9eed5:::rbd_data.1185ba4f1d0d.0000000000000021:12)])", 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.765917944999998, 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015399133000000001, 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-09-21T14:01:08.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334802+0000", 2024-09-21T14:01:08.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334806+0000", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0319999999999997e-06 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334813+0000", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.041e-06 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334818+0000", 2024-09-21T14:01:08.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.566e-06 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.334860+0000", 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2330000000000003e-05 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:50.350202+0000", 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015341662000000001 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:229552 3.e 3:77344450:::rbd_object_map.1185ba4f1d0d:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e147)", 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.847608147000001, 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018807949000000001, 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 229552 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253112+0000", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253108+0000", 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999962 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253129+0000", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0069999999999999e-05 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253174+0000", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.507e-05 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253196+0000", 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2079999999999999e-05 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253329+0000", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013327599999999999 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.253560+0000", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023107100000000001 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.254034+0000", 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00047362400000000002 2024-09-21T14:01:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.255788+0000", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017547769999999999 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271806+0000", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01601735 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271866+0000", 2024-09-21T14:01:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0056000000000002e-05 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:53.271920+0000", 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4419000000000002e-05 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2969 3.12 e153/117 3:4e9dc24d:::rbd_data.1185cd54b1ab.0000000000000001:c v 153'981, mlcod=152'978)", 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8251933860000005, 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023706353999999999, 2024-09-21T14:01:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275527+0000", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275534+0000", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.52e-06 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275559+0000", 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4691000000000001e-05 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275570+0000", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1031e-05 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275713+0000", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014284200000000001 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.275744+0000", 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0916e-05 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299134+0000", 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023389969 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299233+0000", 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9698999999999995e-05 2024-09-21T14:01:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(osd.0.0:2971 3.12 e153/117 3:4ed65898:::rbd_data.1185cd54b1ab.0000000000000005:c v 153'983, mlcod=152'978)", 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8186447609999998, 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017367852999999999, 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282076+0000", 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282074+0000", 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282087+0000", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2891000000000001e-05 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282102+0000", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4834000000000001e-05 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.282112+0000", 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5619999999999993e-06 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288501+0000", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063891599999999996 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.288551+0000", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0049000000000001e-05 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299408+0000", 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010856872 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:00:59.299444+0000", 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5941e-05 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4485.0:231250 3.7 e157/148 3:e64c7ecf:::rbd_object_map.1185e0e4cd61:head v 157'680, mlcod=156'674)", 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7743455590000003, 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012995352, 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326375+0000", 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326374+0000", 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326385+0000", 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1746000000000001e-05 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326407+0000", 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1333000000000001e-05 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.326822+0000", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00041486700000000002 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.328644+0000", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018222170000000001 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.328692+0000", 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7923999999999997e-05 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.339331+0000", 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010639103 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:03.339370+0000", 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9418000000000001e-05 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4485.0:231440 3.f 3:f08786ad:::rbd_header.11854cc47015:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e158)", 2024-09-21T14:01:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-09-21T14:01:04.316315+0000", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.7844050459999998, 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016893436000000001, 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4485", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.79:0/1296370180", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 231440 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316315+0000", 2024-09-21T14:01:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316315+0000", 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-09-21T14:01:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316313+0000", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316330+0000", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.789e-05 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316365+0000", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4906000000000001e-05 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-09-21T14:01:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316383+0000", 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7725999999999999e-05 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316563+0000", 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018005899999999999 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.316578+0000", 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4732999999999999e-05 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.329039+0000", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012460758000000001 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.329283+0000", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024480500000000001 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 4", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.330489+0000", 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001205715 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.332628+0000", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002139134 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.333015+0000", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00038668099999999999 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.333099+0000", 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3626000000000002e-05 2024-09-21T14:01:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-09-21T14:01:04.333209+0000", 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110196 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-21T14:01:08.215 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-21T14:01:08.349 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-21T14:01:10.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-21T14:01:11.007 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-21T14:01:11.007 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-21T14:01:11.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-21T14:01:11.324 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-21T14:01:11.322+0000 7f74c16a6640 -1 mon.a@0(leader).osd e162 definitely_dead 0 2024-09-21T14:01:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-21T14:01:11.375 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.3. 2024-09-21T14:01:11.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-21T14:01:11.409 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-21T14:01:11.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-21T14:01:11.593 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a: {} 2024-09-21T14:01:11.593 INFO:teuthology.orchestra.run.smithi079.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T14:01:11.605 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b: {} 2024-09-21T14:01:11.605 INFO:teuthology.orchestra.run.smithi079.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T14:01:11.615 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c: {} 2024-09-21T14:01:11.615 INFO:teuthology.orchestra.run.smithi079.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-21T14:01:11.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-21T14:01:12.190 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-21T14:01:12.190 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.0 to 1 (10000) 2024-09-21T14:01:12.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-21T14:01:13.196 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-21T14:01:13.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-21T14:01:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.1 to 1 (10000) 2024-09-21T14:01:14.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-21T14:01:15.392 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-21T14:01:15.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-21T14:01:16.396 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.2 to 1 (10000) 2024-09-21T14:01:16.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-21T14:01:17.192 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-21T14:01:17.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-21T14:01:18.194 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.3 to 1 (10000) 2024-09-21T14:01:18.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-21T14:01:19.195 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-21T14:01:19.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-21T14:01:20.201 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.4 to 1 (10000) 2024-09-21T14:01:20.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-21T14:01:21.455 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-21T14:01:21.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-21T14:01:22.460 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.5 to 1 (10000) 2024-09-21T14:01:22.484 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-21T14:01:23.460 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-21T14:01:23.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-21T14:01:24.475 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.6 to 1 (10000) 2024-09-21T14:01:24.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-21T14:01:25.487 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-21T14:01:25.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-21T14:01:26.490 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.7 to 1 (10000) 2024-09-21T14:01:26.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-21T14:01:27.511 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-21T14:01:27.536 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-21T14:01:27.536 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-21T14:01:27.536 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-21T14:01:27.536 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-21T14:01:27.536 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T14:01:27.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T14:01:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:27.822 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":179,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T14:01:27.492303+0000","last_up_change":"2024-09-21T13:59:59.502742+0000","last_in_change":"2024-09-21T14:01:11.362762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T13:58:10.681325+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T13:58:20.114253+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":77,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":43,"up_from":94,"up_thru":145,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6801","nonce":912917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6803","nonce":912917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6807","nonce":912917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6805","nonce":912917640}]},"public_addr":"172.21.15.134:6801/912917640","cluster_addr":"172.21.15.134:6803/912917640","heartbeat_back_addr":"172.21.15.134:6807/912917640","heartbeat_front_addr":"172.21.15.134:6805/912917640","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":45}],"pg_upmap":[{"pgid":"3.1e","osds":[5,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T14:01:27.839 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T14:01:27.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T14:01:28.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:28.118 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":179,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T14:01:27.492303+0000","last_up_change":"2024-09-21T13:59:59.502742+0000","last_in_change":"2024-09-21T14:01:11.362762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T13:58:10.681325+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T13:58:20.114253+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":77,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":43,"up_from":94,"up_thru":145,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6801","nonce":912917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6803","nonce":912917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6807","nonce":912917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6805","nonce":912917640}]},"public_addr":"172.21.15.134:6801/912917640","cluster_addr":"172.21.15.134:6803/912917640","heartbeat_back_addr":"172.21.15.134:6807/912917640","heartbeat_front_addr":"172.21.15.134:6805/912917640","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":45}],"pg_upmap":[{"pgid":"3.1e","osds":[5,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T14:01:28.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T14:01:28.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T14:01:28.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T14:01:28.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T14:01:28.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-21T14:01:28.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-21T14:01:28.137 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-21T14:01:28.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-21T14:01:28.395 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-21T14:01:28.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T14:01:28.401 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:28.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T14:01:28.404 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:28.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T14:01:28.405 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-21T14:01:28.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T14:01:28.406 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:28.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T14:01:28.410 INFO:teuthology.orchestra.run.smithi079.stdout:403726925843 2024-09-21T14:01:28.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T14:01:28.412 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-21T14:01:28.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T14:01:28.417 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:28.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T14:01:28.886 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:28.895 INFO:teuthology.orchestra.run.smithi079.stdout:55834574890 2024-09-21T14:01:28.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.2 2024-09-21T14:01:28.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574890 for osd.3 2024-09-21T14:01:28.929 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-21T14:01:28.929 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:28.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.5 2024-09-21T14:01:28.949 INFO:teuthology.orchestra.run.smithi079.stdout:403726925842 2024-09-21T14:01:28.954 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:28.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.4 2024-09-21T14:01:28.964 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-21T14:01:28.966 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:28.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 403726925843 got 403726925842 for osd.7 2024-09-21T14:01:28.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.1 2024-09-21T14:01:28.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.0 2024-09-21T14:01:28.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.6 2024-09-21T14:01:29.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T14:01:29.921 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T14:01:29.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-21T14:01:29.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-21T14:01:29.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-21T14:01:29.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T14:01:29.989 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T14:01:29.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-21T14:01:30.391 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:30.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.2 2024-09-21T14:01:30.417 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.458 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-21T14:01:30.466 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:30.475 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-21T14:01:30.482 INFO:teuthology.orchestra.run.smithi079.stdout:403726925844 2024-09-21T14:01:30.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.5 2024-09-21T14:01:30.487 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.4 2024-09-21T14:01:30.497 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 403726925843 got 403726925844 for osd.7 2024-09-21T14:01:30.506 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574891 got 55834574891 for osd.3 2024-09-21T14:01:30.509 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.517 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-21T14:01:30.523 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-21T14:01:30.523 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-21T14:01:30.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.6 2024-09-21T14:01:30.542 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.0 2024-09-21T14:01:30.546 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.1 2024-09-21T14:01:30.546 DEBUG:teuthology.parallel:result is None 2024-09-21T14:01:30.547 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-21T14:01:30.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:30.861 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:30.862 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:30.878 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-21T14:01:29.180517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":458144,"kb_used_data":18016,"kb_used_omap":25,"kb_used_meta":439974,"kb_avail":754516576,"statfs":{"total":773094113280,"available":772624973824,"internally_reserved":0,"allocated":18448384,"data_stored":9466080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":450534387},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001374"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3106,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564729+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:26.564729+0000","last_peered":"2024-09-21T14:01:26.564729+0000","last_clean":"2024-09-21T14:01:26.564729+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:26.564729+0000","last_undegraded":"2024-09-21T14:01:26.564729+0000","last_fullsized":"2024-09-21T14:01:26.564729+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18920,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567395+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:26.567395+0000","last_peered":"2024-09-21T14:01:26.567395+0000","last_clean":"2024-09-21T14:01:26.567395+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:26.567395+0000","last_undegraded":"2024-09-21T14:01:26.567395+0000","last_fullsized":"2024-09-21T14:01:26.567395+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7427,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567426+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:26.567426+0000","last_peered":"2024-09-21T14:01:26.567426+0000","last_clean":"2024-09-21T14:01:26.567426+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:26.567426+0000","last_undegraded":"2024-09-21T14:01:26.567426+0000","last_fullsized":"2024-09-21T14:01:26.567426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4516,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.566967+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:26.566967+0000","last_peered":"2024-09-21T14:01:26.566967+0000","last_clean":"2024-09-21T14:01:26.566967+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:26.566967+0000","last_undegraded":"2024-09-21T14:01:26.566967+0000","last_fullsized":"2024-09-21T14:01:26.566967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1947,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564688+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:26.564688+0000","last_peered":"2024-09-21T14:01:26.564688+0000","last_clean":"2024-09-21T14:01:26.564688+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:26.564688+0000","last_undegraded":"2024-09-21T14:01:26.564688+0000","last_fullsized":"2024-09-21T14:01:26.564688+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19577,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489251+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:26.489251+0000","last_peered":"2024-09-21T14:01:26.489251+0000","last_clean":"2024-09-21T14:01:26.489251+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:26.489251+0000","last_undegraded":"2024-09-21T14:01:26.489251+0000","last_fullsized":"2024-09-21T14:01:26.489251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5956,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501213+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:26.501213+0000","last_peered":"2024-09-21T14:01:26.501213+0000","last_clean":"2024-09-21T14:01:26.501213+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:26.501213+0000","last_undegraded":"2024-09-21T14:01:26.501213+0000","last_fullsized":"2024-09-21T14:01:26.501213+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35947,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488026+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:26.488026+0000","last_peered":"2024-09-21T14:01:26.488026+0000","last_clean":"2024-09-21T14:01:26.488026+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:26.488026+0000","last_undegraded":"2024-09-21T14:01:26.488026+0000","last_fullsized":"2024-09-21T14:01:26.488026+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2178,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564835+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:26.564835+0000","last_peered":"2024-09-21T14:01:26.564835+0000","last_clean":"2024-09-21T14:01:26.564835+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:26.564835+0000","last_undegraded":"2024-09-21T14:01:26.564835+0000","last_fullsized":"2024-09-21T14:01:26.564835+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3117,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567396+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:26.567396+0000","last_peered":"2024-09-21T14:01:26.567396+0000","last_clean":"2024-09-21T14:01:26.567396+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:26.567396+0000","last_undegraded":"2024-09-21T14:01:26.567396+0000","last_fullsized":"2024-09-21T14:01:26.567396+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2265,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489415+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:26.489415+0000","last_peered":"2024-09-21T14:01:26.489415+0000","last_clean":"2024-09-21T14:01:26.489415+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:26.489415+0000","last_undegraded":"2024-09-21T14:01:26.489415+0000","last_fullsized":"2024-09-21T14:01:26.489415+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567478+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:26.567478+0000","last_peered":"2024-09-21T14:01:26.567478+0000","last_clean":"2024-09-21T14:01:26.567478+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:26.567478+0000","last_undegraded":"2024-09-21T14:01:26.567478+0000","last_fullsized":"2024-09-21T14:01:26.567478+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2778,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564810+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:26.564810+0000","last_peered":"2024-09-21T14:01:26.564810+0000","last_clean":"2024-09-21T14:01:26.564810+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:26.564810+0000","last_undegraded":"2024-09-21T14:01:26.564810+0000","last_fullsized":"2024-09-21T14:01:26.564810+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501376+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:26.501376+0000","last_peered":"2024-09-21T14:01:26.501376+0000","last_clean":"2024-09-21T14:01:26.501376+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:26.501376+0000","last_undegraded":"2024-09-21T14:01:26.501376+0000","last_fullsized":"2024-09-21T14:01:26.501376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5239,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488956+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:26.488956+0000","last_peered":"2024-09-21T14:01:26.488956+0000","last_clean":"2024-09-21T14:01:26.488956+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:26.488956+0000","last_undegraded":"2024-09-21T14:01:26.488956+0000","last_fullsized":"2024-09-21T14:01:26.488956+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7358,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501669+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:26.501669+0000","last_peered":"2024-09-21T14:01:26.501669+0000","last_clean":"2024-09-21T14:01:26.501669+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:26.501669+0000","last_undegraded":"2024-09-21T14:01:26.501669+0000","last_fullsized":"2024-09-21T14:01:26.501669+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501816+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:26.501816+0000","last_peered":"2024-09-21T14:01:26.501816+0000","last_clean":"2024-09-21T14:01:26.501816+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:26.501816+0000","last_undegraded":"2024-09-21T14:01:26.501816+0000","last_fullsized":"2024-09-21T14:01:26.501816+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20712,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567650+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:26.567650+0000","last_peered":"2024-09-21T14:01:26.567650+0000","last_clean":"2024-09-21T14:01:26.567650+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:26.567650+0000","last_undegraded":"2024-09-21T14:01:26.567650+0000","last_fullsized":"2024-09-21T14:01:26.567650+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1957,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489572+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:26.489572+0000","last_peered":"2024-09-21T14:01:26.489572+0000","last_clean":"2024-09-21T14:01:26.489572+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:26.489572+0000","last_undegraded":"2024-09-21T14:01:26.489572+0000","last_fullsized":"2024-09-21T14:01:26.489572+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":200,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.566939+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:26.566939+0000","last_peered":"2024-09-21T14:01:26.566939+0000","last_clean":"2024-09-21T14:01:26.566939+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:26.566939+0000","last_undegraded":"2024-09-21T14:01:26.566939+0000","last_fullsized":"2024-09-21T14:01:26.566939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22239,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.500883+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:26.500883+0000","last_peered":"2024-09-21T14:01:26.500883+0000","last_clean":"2024-09-21T14:01:26.500883+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:26.500883+0000","last_undegraded":"2024-09-21T14:01:26.500883+0000","last_fullsized":"2024-09-21T14:01:26.500883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488588+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:26.488588+0000","last_peered":"2024-09-21T14:01:26.488588+0000","last_clean":"2024-09-21T14:01:26.488588+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:26.488588+0000","last_undegraded":"2024-09-21T14:01:26.488588+0000","last_fullsized":"2024-09-21T14:01:26.488588+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5260,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564621+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:26.564621+0000","last_peered":"2024-09-21T14:01:26.564621+0000","last_clean":"2024-09-21T14:01:26.564621+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:26.564621+0000","last_undegraded":"2024-09-21T14:01:26.564621+0000","last_fullsized":"2024-09-21T14:01:26.564621+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":180,"state":"activating","last_fresh":"2024-09-21T14:01:28.511942+0000","last_change":"2024-09-21T14:01:28.512335+0000","last_active":"2024-09-21T14:01:14.527663+0000","last_peered":"2024-09-21T14:01:13.193412+0000","last_clean":"2024-09-21T14:01:13.193412+0000","last_became_active":"2024-09-21T14:00:55.240565+0000","last_became_peered":"2024-09-21T14:00:55.240565+0000","last_unstale":"2024-09-21T14:01:28.511942+0000","last_undegraded":"2024-09-21T14:01:28.511942+0000","last_fullsized":"2024-09-21T14:01:28.511942+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20154,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488216+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:26.488216+0000","last_peered":"2024-09-21T14:01:26.488216+0000","last_clean":"2024-09-21T14:01:26.488216+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:26.488216+0000","last_undegraded":"2024-09-21T14:01:26.488216+0000","last_fullsized":"2024-09-21T14:01:26.488216+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":209,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567171+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:26.567171+0000","last_peered":"2024-09-21T14:01:26.567171+0000","last_clean":"2024-09-21T14:01:26.567171+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:26.567171+0000","last_undegraded":"2024-09-21T14:01:26.567171+0000","last_fullsized":"2024-09-21T14:01:26.567171+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3564,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.487891+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:26.487891+0000","last_peered":"2024-09-21T14:01:26.487891+0000","last_clean":"2024-09-21T14:01:26.487891+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:26.487891+0000","last_undegraded":"2024-09-21T14:01:26.487891+0000","last_fullsized":"2024-09-21T14:01:26.487891+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489547+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:26.489547+0000","last_peered":"2024-09-21T14:01:26.489547+0000","last_clean":"2024-09-21T14:01:26.489547+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:26.489547+0000","last_undegraded":"2024-09-21T14:01:26.489547+0000","last_fullsized":"2024-09-21T14:01:26.489547+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16984,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567084+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:26.567084+0000","last_peered":"2024-09-21T14:01:26.567084+0000","last_clean":"2024-09-21T14:01:26.567084+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:26.567084+0000","last_undegraded":"2024-09-21T14:01:26.567084+0000","last_fullsized":"2024-09-21T14:01:26.567084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3983,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488538+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:26.488538+0000","last_peered":"2024-09-21T14:01:26.488538+0000","last_clean":"2024-09-21T14:01:26.488538+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:26.488538+0000","last_undegraded":"2024-09-21T14:01:26.488538+0000","last_fullsized":"2024-09-21T14:01:26.488538+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4209,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567203+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:26.567203+0000","last_peered":"2024-09-21T14:01:26.567203+0000","last_clean":"2024-09-21T14:01:26.567203+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:26.567203+0000","last_undegraded":"2024-09-21T14:01:26.567203+0000","last_fullsized":"2024-09-21T14:01:26.567203+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4856,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567084+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:26.567084+0000","last_peered":"2024-09-21T14:01:26.567084+0000","last_clean":"2024-09-21T14:01:26.567084+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:26.567084+0000","last_undegraded":"2024-09-21T14:01:26.567084+0000","last_fullsized":"2024-09-21T14:01:26.567084+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4992,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564689+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:26.564689+0000","last_peered":"2024-09-21T14:01:26.564689+0000","last_clean":"2024-09-21T14:01:26.564689+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:26.564689+0000","last_undegraded":"2024-09-21T14:01:26.564689+0000","last_fullsized":"2024-09-21T14:01:26.564689+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925844,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47820,"kb_used_data":2688,"kb_used_omap":14,"kb_used_meta":45105,"kb_avail":94324020,"statfs":{"total":96636764160,"available":96587796480,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":46188422},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.256},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2010000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.755}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.175},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.093}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73412,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298428,"statfs":{"total":96636764160,"available":96561590272,"internally_reserved":0,"allocated":2146304,"data_stored":1031277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.101},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.175}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.246},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.071}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":2162688,"data_stored":1037138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.089}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.595},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.4690000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":1.6830000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.798},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.22}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.125}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.522},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.6439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2162688,"data_stored":1037138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":1.038},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":1.1539999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47176,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324664,"statfs":{"total":96636764160,"available":96588455936,"internally_reserved":0,"allocated":2158592,"data_stored":1037119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.376},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.56000000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41412,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330428,"statfs":{"total":96636764160,"available":96594358272,"internally_reserved":0,"allocated":2146304,"data_stored":1031277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.006}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":1.161}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":2166784,"data_stored":1037157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.379}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.292}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.155},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":1.7509999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.8089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.75},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91100000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.96099999999999997}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.264},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.329},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.143},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:30.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:31.157 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:31.158 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:31.173 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-21T14:01:29.180517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":458144,"kb_used_data":18016,"kb_used_omap":25,"kb_used_meta":439974,"kb_avail":754516576,"statfs":{"total":773094113280,"available":772624973824,"internally_reserved":0,"allocated":18448384,"data_stored":9466080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":450534387},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001374"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3106,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564729+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:26.564729+0000","last_peered":"2024-09-21T14:01:26.564729+0000","last_clean":"2024-09-21T14:01:26.564729+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:26.564729+0000","last_undegraded":"2024-09-21T14:01:26.564729+0000","last_fullsized":"2024-09-21T14:01:26.564729+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18920,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567395+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:26.567395+0000","last_peered":"2024-09-21T14:01:26.567395+0000","last_clean":"2024-09-21T14:01:26.567395+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:26.567395+0000","last_undegraded":"2024-09-21T14:01:26.567395+0000","last_fullsized":"2024-09-21T14:01:26.567395+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7427,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567426+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:26.567426+0000","last_peered":"2024-09-21T14:01:26.567426+0000","last_clean":"2024-09-21T14:01:26.567426+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:26.567426+0000","last_undegraded":"2024-09-21T14:01:26.567426+0000","last_fullsized":"2024-09-21T14:01:26.567426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4516,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.566967+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:26.566967+0000","last_peered":"2024-09-21T14:01:26.566967+0000","last_clean":"2024-09-21T14:01:26.566967+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:26.566967+0000","last_undegraded":"2024-09-21T14:01:26.566967+0000","last_fullsized":"2024-09-21T14:01:26.566967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1947,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564688+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:26.564688+0000","last_peered":"2024-09-21T14:01:26.564688+0000","last_clean":"2024-09-21T14:01:26.564688+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:26.564688+0000","last_undegraded":"2024-09-21T14:01:26.564688+0000","last_fullsized":"2024-09-21T14:01:26.564688+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19577,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489251+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:26.489251+0000","last_peered":"2024-09-21T14:01:26.489251+0000","last_clean":"2024-09-21T14:01:26.489251+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:26.489251+0000","last_undegraded":"2024-09-21T14:01:26.489251+0000","last_fullsized":"2024-09-21T14:01:26.489251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5956,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501213+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:26.501213+0000","last_peered":"2024-09-21T14:01:26.501213+0000","last_clean":"2024-09-21T14:01:26.501213+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:26.501213+0000","last_undegraded":"2024-09-21T14:01:26.501213+0000","last_fullsized":"2024-09-21T14:01:26.501213+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35947,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488026+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:26.488026+0000","last_peered":"2024-09-21T14:01:26.488026+0000","last_clean":"2024-09-21T14:01:26.488026+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:26.488026+0000","last_undegraded":"2024-09-21T14:01:26.488026+0000","last_fullsized":"2024-09-21T14:01:26.488026+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2178,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564835+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:26.564835+0000","last_peered":"2024-09-21T14:01:26.564835+0000","last_clean":"2024-09-21T14:01:26.564835+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:26.564835+0000","last_undegraded":"2024-09-21T14:01:26.564835+0000","last_fullsized":"2024-09-21T14:01:26.564835+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3117,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567396+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:26.567396+0000","last_peered":"2024-09-21T14:01:26.567396+0000","last_clean":"2024-09-21T14:01:26.567396+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:26.567396+0000","last_undegraded":"2024-09-21T14:01:26.567396+0000","last_fullsized":"2024-09-21T14:01:26.567396+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2265,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489415+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:26.489415+0000","last_peered":"2024-09-21T14:01:26.489415+0000","last_clean":"2024-09-21T14:01:26.489415+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:26.489415+0000","last_undegraded":"2024-09-21T14:01:26.489415+0000","last_fullsized":"2024-09-21T14:01:26.489415+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":188,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567478+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:26.567478+0000","last_peered":"2024-09-21T14:01:26.567478+0000","last_clean":"2024-09-21T14:01:26.567478+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:26.567478+0000","last_undegraded":"2024-09-21T14:01:26.567478+0000","last_fullsized":"2024-09-21T14:01:26.567478+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2778,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564810+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:26.564810+0000","last_peered":"2024-09-21T14:01:26.564810+0000","last_clean":"2024-09-21T14:01:26.564810+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:26.564810+0000","last_undegraded":"2024-09-21T14:01:26.564810+0000","last_fullsized":"2024-09-21T14:01:26.564810+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501376+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:26.501376+0000","last_peered":"2024-09-21T14:01:26.501376+0000","last_clean":"2024-09-21T14:01:26.501376+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:26.501376+0000","last_undegraded":"2024-09-21T14:01:26.501376+0000","last_fullsized":"2024-09-21T14:01:26.501376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5239,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488956+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:26.488956+0000","last_peered":"2024-09-21T14:01:26.488956+0000","last_clean":"2024-09-21T14:01:26.488956+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:26.488956+0000","last_undegraded":"2024-09-21T14:01:26.488956+0000","last_fullsized":"2024-09-21T14:01:26.488956+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7358,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501669+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:26.501669+0000","last_peered":"2024-09-21T14:01:26.501669+0000","last_clean":"2024-09-21T14:01:26.501669+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:26.501669+0000","last_undegraded":"2024-09-21T14:01:26.501669+0000","last_fullsized":"2024-09-21T14:01:26.501669+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.501816+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:26.501816+0000","last_peered":"2024-09-21T14:01:26.501816+0000","last_clean":"2024-09-21T14:01:26.501816+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:26.501816+0000","last_undegraded":"2024-09-21T14:01:26.501816+0000","last_fullsized":"2024-09-21T14:01:26.501816+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20712,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567650+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:26.567650+0000","last_peered":"2024-09-21T14:01:26.567650+0000","last_clean":"2024-09-21T14:01:26.567650+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:26.567650+0000","last_undegraded":"2024-09-21T14:01:26.567650+0000","last_fullsized":"2024-09-21T14:01:26.567650+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1957,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489572+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:26.489572+0000","last_peered":"2024-09-21T14:01:26.489572+0000","last_clean":"2024-09-21T14:01:26.489572+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:26.489572+0000","last_undegraded":"2024-09-21T14:01:26.489572+0000","last_fullsized":"2024-09-21T14:01:26.489572+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":200,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.566939+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:26.566939+0000","last_peered":"2024-09-21T14:01:26.566939+0000","last_clean":"2024-09-21T14:01:26.566939+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:26.566939+0000","last_undegraded":"2024-09-21T14:01:26.566939+0000","last_fullsized":"2024-09-21T14:01:26.566939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22239,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.500883+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:26.500883+0000","last_peered":"2024-09-21T14:01:26.500883+0000","last_clean":"2024-09-21T14:01:26.500883+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:26.500883+0000","last_undegraded":"2024-09-21T14:01:26.500883+0000","last_fullsized":"2024-09-21T14:01:26.500883+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488588+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:26.488588+0000","last_peered":"2024-09-21T14:01:26.488588+0000","last_clean":"2024-09-21T14:01:26.488588+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:26.488588+0000","last_undegraded":"2024-09-21T14:01:26.488588+0000","last_fullsized":"2024-09-21T14:01:26.488588+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5260,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564621+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:26.564621+0000","last_peered":"2024-09-21T14:01:26.564621+0000","last_clean":"2024-09-21T14:01:26.564621+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:26.564621+0000","last_undegraded":"2024-09-21T14:01:26.564621+0000","last_fullsized":"2024-09-21T14:01:26.564621+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":180,"state":"activating","last_fresh":"2024-09-21T14:01:28.511942+0000","last_change":"2024-09-21T14:01:28.512335+0000","last_active":"2024-09-21T14:01:14.527663+0000","last_peered":"2024-09-21T14:01:13.193412+0000","last_clean":"2024-09-21T14:01:13.193412+0000","last_became_active":"2024-09-21T14:00:55.240565+0000","last_became_peered":"2024-09-21T14:00:55.240565+0000","last_unstale":"2024-09-21T14:01:28.511942+0000","last_undegraded":"2024-09-21T14:01:28.511942+0000","last_fullsized":"2024-09-21T14:01:28.511942+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20154,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488216+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:26.488216+0000","last_peered":"2024-09-21T14:01:26.488216+0000","last_clean":"2024-09-21T14:01:26.488216+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:26.488216+0000","last_undegraded":"2024-09-21T14:01:26.488216+0000","last_fullsized":"2024-09-21T14:01:26.488216+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":209,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567171+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:26.567171+0000","last_peered":"2024-09-21T14:01:26.567171+0000","last_clean":"2024-09-21T14:01:26.567171+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:26.567171+0000","last_undegraded":"2024-09-21T14:01:26.567171+0000","last_fullsized":"2024-09-21T14:01:26.567171+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3564,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.487891+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:26.487891+0000","last_peered":"2024-09-21T14:01:26.487891+0000","last_clean":"2024-09-21T14:01:26.487891+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:26.487891+0000","last_undegraded":"2024-09-21T14:01:26.487891+0000","last_fullsized":"2024-09-21T14:01:26.487891+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2889,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.489547+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:26.489547+0000","last_peered":"2024-09-21T14:01:26.489547+0000","last_clean":"2024-09-21T14:01:26.489547+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:26.489547+0000","last_undegraded":"2024-09-21T14:01:26.489547+0000","last_fullsized":"2024-09-21T14:01:26.489547+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16984,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567084+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:26.567084+0000","last_peered":"2024-09-21T14:01:26.567084+0000","last_clean":"2024-09-21T14:01:26.567084+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:26.567084+0000","last_undegraded":"2024-09-21T14:01:26.567084+0000","last_fullsized":"2024-09-21T14:01:26.567084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3983,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.488538+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:26.488538+0000","last_peered":"2024-09-21T14:01:26.488538+0000","last_clean":"2024-09-21T14:01:26.488538+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:26.488538+0000","last_undegraded":"2024-09-21T14:01:26.488538+0000","last_fullsized":"2024-09-21T14:01:26.488538+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4209,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567203+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:26.567203+0000","last_peered":"2024-09-21T14:01:26.567203+0000","last_clean":"2024-09-21T14:01:26.567203+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:26.567203+0000","last_undegraded":"2024-09-21T14:01:26.567203+0000","last_fullsized":"2024-09-21T14:01:26.567203+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4856,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.567084+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:26.567084+0000","last_peered":"2024-09-21T14:01:26.567084+0000","last_clean":"2024-09-21T14:01:26.567084+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:26.567084+0000","last_undegraded":"2024-09-21T14:01:26.567084+0000","last_fullsized":"2024-09-21T14:01:26.567084+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4992,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-21T14:01:26.564689+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:26.564689+0000","last_peered":"2024-09-21T14:01:26.564689+0000","last_clean":"2024-09-21T14:01:26.564689+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:26.564689+0000","last_undegraded":"2024-09-21T14:01:26.564689+0000","last_fullsized":"2024-09-21T14:01:26.564689+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925844,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47820,"kb_used_data":2688,"kb_used_omap":14,"kb_used_meta":45105,"kb_avail":94324020,"statfs":{"total":96636764160,"available":96587796480,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":46188422},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.256},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2010000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.755}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.175},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.093}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73412,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298428,"statfs":{"total":96636764160,"available":96561590272,"internally_reserved":0,"allocated":2146304,"data_stored":1031277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.101},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.175}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.246},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.071}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":2162688,"data_stored":1037138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.089}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.595},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.4690000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":1.6830000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.798},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.22}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.125}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.522},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.6439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2112,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2162688,"data_stored":1037138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":1.038},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":1.1539999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47176,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324664,"statfs":{"total":96636764160,"available":96588455936,"internally_reserved":0,"allocated":2158592,"data_stored":1037119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.376},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.56000000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41412,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330428,"statfs":{"total":96636764160,"available":96594358272,"internally_reserved":0,"allocated":2146304,"data_stored":1031277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.006}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":1.161}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":2166784,"data_stored":1037157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.379}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.63100000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.292}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.89400000000000002}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.155},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":1.7509999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.8089999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2688,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.63100000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.82399999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.75},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.91100000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.96099999999999997}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.264},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.88200000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.329},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.93300000000000005}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.143},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:31.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T14:01:31.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:31.495 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":219,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":180,"num_osds":8,"num_up_osds":8,"osd_up_since":1726927199,"num_in_osds":8,"osd_in_since":1726927271,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":40},{"state_name":"activating","count":1}],"num_pgs":41,"num_pools":3,"num_objects":592,"data_bytes":590406,"bytes_used":469139456,"bytes_avail":772624973824,"bytes_total":773094113280,"inactive_pgs_ratio":0.024390242993831635},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-21T14:00:59.171113+0000","services":{}},"progress_events":{}} 2024-09-21T14:01:31.512 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T14:01:31.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:31.792 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:31.793 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:31.809 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-21T14:01:31.181107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":458240,"kb_used_data":18124,"kb_used_omap":25,"kb_used_meta":439974,"kb_avail":754516480,"statfs":{"total":773094113280,"available":772624875520,"internally_reserved":0,"allocated":18558976,"data_stored":9518658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":450534387},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.697591"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":180,"state":"activating","last_fresh":"2024-09-21T14:01:28.511942+0000","last_change":"2024-09-21T14:01:28.512335+0000","last_active":"2024-09-21T14:01:14.527663+0000","last_peered":"2024-09-21T14:01:13.193412+0000","last_clean":"2024-09-21T14:01:13.193412+0000","last_became_active":"2024-09-21T14:00:55.240565+0000","last_became_peered":"2024-09-21T14:00:55.240565+0000","last_unstale":"2024-09-21T14:01:28.511942+0000","last_undegraded":"2024-09-21T14:01:28.511942+0000","last_fullsized":"2024-09-21T14:01:28.511942+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925844,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47820,"kb_used_data":2688,"kb_used_omap":14,"kb_used_meta":45105,"kb_avail":94324020,"statfs":{"total":96636764160,"available":96587796480,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":46188422},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.256},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2010000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.755}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.175},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.093}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.101},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.175}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.246},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.071}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.089}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.595},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.4690000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":1.6830000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.798},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.22}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.125}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.522},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.6439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":1.038},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":1.1539999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.376},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.56000000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.006}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":1.161}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.752},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.056},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.90900000000000003}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.80300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":4.3399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.624}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":4.2869999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":4.3899999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":4.774},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.81499999999999995}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":4.9219999999999997},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:34.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:35.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:35.125 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:35.141 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T14:01:33.181761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":458240,"kb_used_data":18124,"kb_used_omap":25,"kb_used_meta":439974,"kb_avail":754516480,"statfs":{"total":773094113280,"available":772624875520,"internally_reserved":0,"allocated":18558976,"data_stored":9518658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":450534387},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.695661"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":125,"reported_epoch":180,"state":"activating","last_fresh":"2024-09-21T14:01:28.511942+0000","last_change":"2024-09-21T14:01:28.512335+0000","last_active":"2024-09-21T14:01:14.527663+0000","last_peered":"2024-09-21T14:01:13.193412+0000","last_clean":"2024-09-21T14:01:13.193412+0000","last_became_active":"2024-09-21T14:00:55.240565+0000","last_became_peered":"2024-09-21T14:00:55.240565+0000","last_unstale":"2024-09-21T14:01:28.511942+0000","last_undegraded":"2024-09-21T14:01:28.511942+0000","last_fullsized":"2024-09-21T14:01:28.511942+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925844,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47820,"kb_used_data":2688,"kb_used_omap":14,"kb_used_meta":45105,"kb_avail":94324020,"statfs":{"total":96636764160,"available":96587796480,"internally_reserved":0,"allocated":2752512,"data_stored":1627487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":46188422},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.256},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.88500000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.84599999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.999},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.2010000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.755}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.3049999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.175},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.093}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.72199999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.101},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.93100000000000005}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.175}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.246},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.071}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.089}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.84499999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.595},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.4690000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":1.6830000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.93100000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.798},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.22}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.125}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.522},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.6439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":1.038},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":1.1539999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.1970000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.876}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.1080000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.82699999999999996}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.376},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.56000000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.77100000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":0.98699999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.006}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.84399999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.4259999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":1.161}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0600000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.139}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.82899999999999996}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.752},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.66200000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.68500000000000005}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.056},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.90900000000000003}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.89700000000000002}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.80300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":4.3399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.624}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":4.2869999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":4.3899999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":4.774},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.81499999999999995}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":4.9219999999999997},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.76500000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.84899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:35.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-21T14:01:35.470 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:35.470 INFO:teuthology.orchestra.run.smithi079.stdout:{"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":223,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":180,"num_osds":8,"num_up_osds":8,"osd_up_since":1726927199,"num_in_osds":8,"osd_in_since":1726927271,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":41}],"num_pgs":41,"num_pools":3,"num_objects":592,"data_bytes":590406,"bytes_used":452476928,"bytes_avail":772641636352,"bytes_total":773094113280},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-21T14:00:59.171113+0000","services":{}},"progress_events":{}} 2024-09-21T14:01:35.488 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-21T14:01:35.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:35.775 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:35.776 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:35.793 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T14:01:35.182287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441872,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532848,"statfs":{"total":773094113280,"available":772641636352,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002346"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925845,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.747},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.625}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.99399999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.145}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.163},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.01},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.218}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.93100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.129}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.032},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.262},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.872},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.052}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.63}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.98699999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.012},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.79900000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.123}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.623}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.083},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.028},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.995}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.165},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.746}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.071},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.044}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.276},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.123},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:38.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:39.109 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:39.110 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:39.127 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2024-09-21T14:01:37.183001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441872,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532848,"statfs":{"total":773094113280,"available":772641636352,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.676373"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925845,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.747},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.48199999999999998}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.625}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.88200000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.99399999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.145}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.163},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.01},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.218}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.93100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.129}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.032},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.262},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.872},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.052}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.63}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.98699999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.012},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.79900000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.123}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.623}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.083},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.028},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.995}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.165},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.746}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.071},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.044}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.276},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.123},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:39.130 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-21T14:01:39.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-21T14:01:39.441 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T14:01:39.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T14:01:39.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:39.725 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:39.726 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:39.742 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-21T14:01:39.183516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441872,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532848,"statfs":{"total":773094113280,"available":772641636352,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.671268"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925846,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.97699999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.04},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0720000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.163},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.01},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.218}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.93100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.129}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.032},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.262},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.872},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.052}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.63}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.98699999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.012},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.79900000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.123}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.623}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.083},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.028},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.995}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.165},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.746}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.071},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.044}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.276},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.123},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:39.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:40.036 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:40.037 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:40.054 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-21T14:01:39.183516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441872,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532848,"statfs":{"total":773094113280,"available":772641636352,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.671268"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925846,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.97699999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.04},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0720000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.163},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.01},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.218}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.93100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.129}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.032},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.262},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.872},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.052}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.63}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.98699999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.012},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.79900000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.123}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.623}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.083},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.028},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.995}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.165},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.746}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.071},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.044}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.276},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.123},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:40.057 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T14:01:40.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:40.333 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:40.334 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:40.350 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-21T14:01:39.183516+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21503,"ondisk_log_size":21503,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441872,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532848,"statfs":{"total":773094113280,"available":772641636352,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.671268"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3107,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729713+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:27.729713+0000","last_peered":"2024-09-21T14:01:27.729713+0000","last_clean":"2024-09-21T14:01:27.729713+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:27.729713+0000","last_undegraded":"2024-09-21T14:01:27.729713+0000","last_fullsized":"2024-09-21T14:01:27.729713+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:24:33.574293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18921,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516038+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:27.516038+0000","last_peered":"2024-09-21T14:01:27.516038+0000","last_clean":"2024-09-21T14:01:27.516038+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:27.516038+0000","last_undegraded":"2024-09-21T14:01:27.516038+0000","last_fullsized":"2024-09-21T14:01:27.516038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:09:56.560651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7428,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517151+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:27.517151+0000","last_peered":"2024-09-21T14:01:27.517151+0000","last_clean":"2024-09-21T14:01:27.517151+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:27.517151+0000","last_undegraded":"2024-09-21T14:01:27.517151+0000","last_fullsized":"2024-09-21T14:01:27.517151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:35:47.829967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4517,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515831+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:27.515831+0000","last_peered":"2024-09-21T14:01:27.515831+0000","last_clean":"2024-09-21T14:01:27.515831+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:27.515831+0000","last_undegraded":"2024-09-21T14:01:27.515831+0000","last_fullsized":"2024-09-21T14:01:27.515831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:46:11.018537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729650+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:27.729650+0000","last_peered":"2024-09-21T14:01:27.729650+0000","last_clean":"2024-09-21T14:01:27.729650+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:27.729650+0000","last_undegraded":"2024-09-21T14:01:27.729650+0000","last_fullsized":"2024-09-21T14:01:27.729650+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:00:28.946193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19578,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505250+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:27.505250+0000","last_peered":"2024-09-21T14:01:27.505250+0000","last_clean":"2024-09-21T14:01:27.505250+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:27.505250+0000","last_undegraded":"2024-09-21T14:01:27.505250+0000","last_fullsized":"2024-09-21T14:01:27.505250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:37.295640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5957,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509204+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:27.509204+0000","last_peered":"2024-09-21T14:01:27.509204+0000","last_clean":"2024-09-21T14:01:27.509204+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:27.509204+0000","last_undegraded":"2024-09-21T14:01:27.509204+0000","last_fullsized":"2024-09-21T14:01:27.509204+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:45:32.624665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35948,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513597+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:27.513597+0000","last_peered":"2024-09-21T14:01:27.513597+0000","last_clean":"2024-09-21T14:01:27.513597+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:27.513597+0000","last_undegraded":"2024-09-21T14:01:27.513597+0000","last_fullsized":"2024-09-21T14:01:27.513597+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:44:06.949119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2179,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729716+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:27.729716+0000","last_peered":"2024-09-21T14:01:27.729716+0000","last_clean":"2024-09-21T14:01:27.729716+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:27.729716+0000","last_undegraded":"2024-09-21T14:01:27.729716+0000","last_fullsized":"2024-09-21T14:01:27.729716+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:21.149327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3118,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516187+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:27.516187+0000","last_peered":"2024-09-21T14:01:27.516187+0000","last_clean":"2024-09-21T14:01:27.516187+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:27.516187+0000","last_undegraded":"2024-09-21T14:01:27.516187+0000","last_fullsized":"2024-09-21T14:01:27.516187+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:26:20.851680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2266,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505564+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:27.505564+0000","last_peered":"2024-09-21T14:01:27.505564+0000","last_clean":"2024-09-21T14:01:27.505564+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:27.505564+0000","last_undegraded":"2024-09-21T14:01:27.505564+0000","last_fullsized":"2024-09-21T14:01:27.505564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:42.203011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2779,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729621+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:27.729621+0000","last_peered":"2024-09-21T14:01:27.729621+0000","last_clean":"2024-09-21T14:01:27.729621+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:27.729621+0000","last_undegraded":"2024-09-21T14:01:27.729621+0000","last_fullsized":"2024-09-21T14:01:27.729621+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:45:36.277458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509465+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:27.509465+0000","last_peered":"2024-09-21T14:01:27.509465+0000","last_clean":"2024-09-21T14:01:27.509465+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:27.509465+0000","last_undegraded":"2024-09-21T14:01:27.509465+0000","last_fullsized":"2024-09-21T14:01:27.509465+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:20:59.428766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513915+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:27.513915+0000","last_peered":"2024-09-21T14:01:27.513915+0000","last_clean":"2024-09-21T14:01:27.513915+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:27.513915+0000","last_undegraded":"2024-09-21T14:01:27.513915+0000","last_fullsized":"2024-09-21T14:01:27.513915+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:46:09.781618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7359,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509452+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:27.509452+0000","last_peered":"2024-09-21T14:01:27.509452+0000","last_clean":"2024-09-21T14:01:27.509452+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:27.509452+0000","last_undegraded":"2024-09-21T14:01:27.509452+0000","last_fullsized":"2024-09-21T14:01:27.509452+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:17:36.710345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509660+0000","last_change":"2024-09-21T14:01:15.399291+0000","last_active":"2024-09-21T14:01:27.509660+0000","last_peered":"2024-09-21T14:01:27.509660+0000","last_clean":"2024-09-21T14:01:27.509660+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:27.509660+0000","last_undegraded":"2024-09-21T14:01:27.509660+0000","last_fullsized":"2024-09-21T14:01:27.509660+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:25:51.533860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20713,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.517202+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:27.517202+0000","last_peered":"2024-09-21T14:01:27.517202+0000","last_clean":"2024-09-21T14:01:27.517202+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:27.517202+0000","last_undegraded":"2024-09-21T14:01:27.517202+0000","last_fullsized":"2024-09-21T14:01:27.517202+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:50:41.176891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1958,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505691+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:27.505691+0000","last_peered":"2024-09-21T14:01:27.505691+0000","last_clean":"2024-09-21T14:01:27.505691+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:27.505691+0000","last_undegraded":"2024-09-21T14:01:27.505691+0000","last_fullsized":"2024-09-21T14:01:27.505691+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:44:04.750272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":201,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515787+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:27.515787+0000","last_peered":"2024-09-21T14:01:27.515787+0000","last_clean":"2024-09-21T14:01:27.515787+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:27.515787+0000","last_undegraded":"2024-09-21T14:01:27.515787+0000","last_fullsized":"2024-09-21T14:01:27.515787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:28.581782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22240,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509087+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:27.509087+0000","last_peered":"2024-09-21T14:01:27.509087+0000","last_clean":"2024-09-21T14:01:27.509087+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:27.509087+0000","last_undegraded":"2024-09-21T14:01:27.509087+0000","last_fullsized":"2024-09-21T14:01:27.509087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:25:21.373471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.508622+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:27.508622+0000","last_peered":"2024-09-21T14:01:27.508622+0000","last_clean":"2024-09-21T14:01:27.508622+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:27.508622+0000","last_undegraded":"2024-09-21T14:01:27.508622+0000","last_fullsized":"2024-09-21T14:01:27.508622+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:53:29.924839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"159'643","reported_seq":5261,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729443+0000","last_change":"2024-09-21T14:01:07.205156+0000","last_active":"2024-09-21T14:01:27.729443+0000","last_peered":"2024-09-21T14:01:27.729443+0000","last_clean":"2024-09-21T14:01:27.729443+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:27.729443+0000","last_undegraded":"2024-09-21T14:01:27.729443+0000","last_fullsized":"2024-09-21T14:01:27.729443+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:20:15.625562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20155,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513603+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:27.513603+0000","last_peered":"2024-09-21T14:01:27.513603+0000","last_clean":"2024-09-21T14:01:27.513603+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:27.513603+0000","last_undegraded":"2024-09-21T14:01:27.513603+0000","last_fullsized":"2024-09-21T14:01:27.513603+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:09:27.540038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.515797+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:27.515797+0000","last_peered":"2024-09-21T14:01:27.515797+0000","last_clean":"2024-09-21T14:01:27.515797+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:27.515797+0000","last_undegraded":"2024-09-21T14:01:27.515797+0000","last_fullsized":"2024-09-21T14:01:27.515797+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:50:27.916170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3565,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513852+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:27.513852+0000","last_peered":"2024-09-21T14:01:27.513852+0000","last_clean":"2024-09-21T14:01:27.513852+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:27.513852+0000","last_undegraded":"2024-09-21T14:01:27.513852+0000","last_fullsized":"2024-09-21T14:01:27.513852+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:58:36.794644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2890,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.505242+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:27.505242+0000","last_peered":"2024-09-21T14:01:27.505242+0000","last_clean":"2024-09-21T14:01:27.505242+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:27.505242+0000","last_undegraded":"2024-09-21T14:01:27.505242+0000","last_fullsized":"2024-09-21T14:01:27.505242+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:32:50.173811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3984,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.513734+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:27.513734+0000","last_peered":"2024-09-21T14:01:27.513734+0000","last_clean":"2024-09-21T14:01:27.513734+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:27.513734+0000","last_undegraded":"2024-09-21T14:01:27.513734+0000","last_fullsized":"2024-09-21T14:01:27.513734+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:04:53.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4210,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.516070+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:27.516070+0000","last_peered":"2024-09-21T14:01:27.516070+0000","last_clean":"2024-09-21T14:01:27.516070+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:27.516070+0000","last_undegraded":"2024-09-21T14:01:27.516070+0000","last_fullsized":"2024-09-21T14:01:27.516070+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:06.534750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4993,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.729454+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:27.729454+0000","last_peered":"2024-09-21T14:01:27.729454+0000","last_clean":"2024-09-21T14:01:27.729454+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:27.729454+0000","last_undegraded":"2024-09-21T14:01:27.729454+0000","last_fullsized":"2024-09-21T14:01:27.729454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:30.331972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21383,"ondisk_log_size":21383,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925846,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.97699999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.90500000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.04},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0720000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.85799999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.95399999999999996}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.04},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.97399999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.163},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":1.0740000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":1.127}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.01},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79500000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.218}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.97299999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.93100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51288,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320552,"statfs":{"total":96636764160,"available":96584245248,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":1.129}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.032},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.875}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.262},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.502}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.443},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.51500000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.78100000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.92900000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.872},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.052}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.63}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.69699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.65900000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.98699999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.012},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.79900000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0780000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.123}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.623}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.083},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0569999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.96399999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.028},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.995}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.165},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1319999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96152,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275688,"statfs":{"total":96636764160,"available":96538304512,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.746}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90100000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82099999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.071},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.044}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86299999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.276},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":0.97599999999999998}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.123},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.93799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:40.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T14:01:40.634 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:40.634 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":180,"fsid":"af11199c-39d9-4003-9df0-1f9fd66ab792","created":"2024-09-21T13:57:52.430765+0000","modified":"2024-09-21T14:01:28.500289+0000","last_up_change":"2024-09-21T13:59:59.502742+0000","last_in_change":"2024-09-21T14:01:11.362762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T13:58:05.200492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T13:58:10.681325+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-21T13:58:20.114253+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":77,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f3cec52-e90a-4dc6-8a9d-879659a7f8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6818","nonce":3285725925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6823","nonce":3285725925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6831","nonce":3285725925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3285725925},{"type":"v1","addr":"172.21.15.79:6827","nonce":3285725925}]},"public_addr":"172.21.15.79:6818/3285725925","cluster_addr":"172.21.15.79:6823/3285725925","heartbeat_back_addr":"172.21.15.79:6831/3285725925","heartbeat_front_addr":"172.21.15.79:6827/3285725925","state":["exists","up"]},{"osd":1,"uuid":"f30fdaae-2baf-49e5-b8c2-24477eabf5c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6819","nonce":1533952849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6822","nonce":1533952849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6830","nonce":1533952849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1533952849},{"type":"v1","addr":"172.21.15.79:6826","nonce":1533952849}]},"public_addr":"172.21.15.79:6819/1533952849","cluster_addr":"172.21.15.79:6822/1533952849","heartbeat_back_addr":"172.21.15.79:6830/1533952849","heartbeat_front_addr":"172.21.15.79:6826/1533952849","state":["exists","up"]},{"osd":2,"uuid":"54acbaba-89a5-4b6c-bd93-89e0683f2125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6801","nonce":3403916996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6803","nonce":3403916996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6807","nonce":3403916996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":3403916996},{"type":"v1","addr":"172.21.15.79:6805","nonce":3403916996}]},"public_addr":"172.21.15.79:6801/3403916996","cluster_addr":"172.21.15.79:6803/3403916996","heartbeat_back_addr":"172.21.15.79:6807/3403916996","heartbeat_front_addr":"172.21.15.79:6805/3403916996","state":["exists","up"]},{"osd":3,"uuid":"76fc66bf-6186-4666-b92f-c8093d20d625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6809","nonce":3937234571}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6811","nonce":3937234571}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6815","nonce":3937234571}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":3937234571},{"type":"v1","addr":"172.21.15.79:6813","nonce":3937234571}]},"public_addr":"172.21.15.79:6809/3937234571","cluster_addr":"172.21.15.79:6811/3937234571","heartbeat_back_addr":"172.21.15.79:6815/3937234571","heartbeat_front_addr":"172.21.15.79:6813/3937234571","state":["exists","up"]},{"osd":4,"uuid":"c90b7f74-168e-4c89-b1cf-c9ce463afa6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6825","nonce":3468135680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6827","nonce":3468135680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6831","nonce":3468135680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3468135680},{"type":"v1","addr":"172.21.15.134:6829","nonce":3468135680}]},"public_addr":"172.21.15.134:6825/3468135680","cluster_addr":"172.21.15.134:6827/3468135680","heartbeat_back_addr":"172.21.15.134:6831/3468135680","heartbeat_front_addr":"172.21.15.134:6829/3468135680","state":["exists","up"]},{"osd":5,"uuid":"b837d993-44f1-4dd3-99f7-675e6abcd9c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6817","nonce":3245816486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6819","nonce":3245816486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6823","nonce":3245816486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3245816486},{"type":"v1","addr":"172.21.15.134:6821","nonce":3245816486}]},"public_addr":"172.21.15.134:6817/3245816486","cluster_addr":"172.21.15.134:6819/3245816486","heartbeat_back_addr":"172.21.15.134:6823/3245816486","heartbeat_front_addr":"172.21.15.134:6821/3245816486","state":["exists","up"]},{"osd":6,"uuid":"c68ceefc-f355-4f66-870e-95ce4a9bc37e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6809","nonce":2399307560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6811","nonce":2399307560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6815","nonce":2399307560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2399307560},{"type":"v1","addr":"172.21.15.134:6813","nonce":2399307560}]},"public_addr":"172.21.15.134:6809/2399307560","cluster_addr":"172.21.15.134:6811/2399307560","heartbeat_back_addr":"172.21.15.134:6815/2399307560","heartbeat_front_addr":"172.21.15.134:6813/2399307560","state":["exists","up"]},{"osd":7,"uuid":"e1909a46-859c-45e8-b84b-0e11db556c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":43,"up_from":94,"up_thru":179,"down_at":45,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6801","nonce":912917640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6803","nonce":912917640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6807","nonce":912917640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":912917640},{"type":"v1","addr":"172.21.15.134:6805","nonce":912917640}]},"public_addr":"172.21.15.134:6801/912917640","cluster_addr":"172.21.15.134:6803/912917640","heartbeat_back_addr":"172.21.15.134:6807/912917640","heartbeat_front_addr":"172.21.15.134:6805/912917640","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.368141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.343898+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.285851+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.330406+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.151465+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.197502+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T13:58:00.171570+0000","dead_epoch":45}],"pg_upmap":[{"pgid":"3.1e","osds":[5,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T14:01:41.653 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T14:01:41.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:41.811 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:41.811 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:41.811 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:41.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T14:01:42.116 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T14:01:42.133 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T14:01:42.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:42.275 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:42.275 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:42.275 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:42.290 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T14:01:42.554 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T14:01:42.572 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T14:01:42.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:42.713 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:42.713 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:42.713 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:42.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T14:01:43.011 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T14:01:43.029 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T14:01:43.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:43.170 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:43.170 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:43.171 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:43.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T14:01:43.456 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T14:01:43.474 INFO:tasks.ceph:Scrubbing osd.4 2024-09-21T14:01:43.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:43.621 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:43.622 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:43.622 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:43.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-21T14:01:43.911 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2024-09-21T14:01:43.929 INFO:tasks.ceph:Scrubbing osd.5 2024-09-21T14:01:43.929 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:44.064 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:44.065 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:44.065 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:44.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-21T14:01:44.354 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2024-09-21T14:01:44.371 INFO:tasks.ceph:Scrubbing osd.6 2024-09-21T14:01:44.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:44.518 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:44.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-21T14:01:44.800 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2024-09-21T14:01:44.818 INFO:tasks.ceph:Scrubbing osd.7 2024-09-21T14:01:44.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-21T14:01:44.962 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T14:01:44.962 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-21T14:01:44.962 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T14:01:44.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-21T14:01:45.272 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2024-09-21T14:01:45.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:01:45.570 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:01:45.571 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:01:45.587 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-21T14:01:45.185390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21518,"ondisk_log_size":21518,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441864,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":423590,"kb_avail":754532856,"statfs":{"total":773094113280,"available":772641644544,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":433757171},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003629"},"pg_stats":[{"pgid":"3.1f","version":"161'421","reported_seq":3108,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511997+0000","last_change":"2024-09-21T14:01:07.209051+0000","last_active":"2024-09-21T14:01:28.511997+0000","last_peered":"2024-09-21T14:01:28.511997+0000","last_clean":"2024-09-21T14:01:28.511997+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:28.511997+0000","last_undegraded":"2024-09-21T14:01:28.511997+0000","last_fullsized":"2024-09-21T14:01:28.511997+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18922,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517393+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:28.517393+0000","last_peered":"2024-09-21T14:01:28.517393+0000","last_clean":"2024-09-21T14:01:28.517393+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:28.517393+0000","last_undegraded":"2024-09-21T14:01:28.517393+0000","last_fullsized":"2024-09-21T14:01:28.517393+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7429,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517610+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:28.517610+0000","last_peered":"2024-09-21T14:01:28.517610+0000","last_clean":"2024-09-21T14:01:28.517610+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:28.517610+0000","last_undegraded":"2024-09-21T14:01:28.517610+0000","last_fullsized":"2024-09-21T14:01:28.517610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4518,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517401+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:28.517401+0000","last_peered":"2024-09-21T14:01:28.517401+0000","last_clean":"2024-09-21T14:01:28.517401+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:28.517401+0000","last_undegraded":"2024-09-21T14:01:28.517401+0000","last_fullsized":"2024-09-21T14:01:28.517401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"158'426","reported_seq":1949,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511977+0000","last_change":"2024-09-21T14:01:07.210834+0000","last_active":"2024-09-21T14:01:28.511977+0000","last_peered":"2024-09-21T14:01:28.511977+0000","last_clean":"2024-09-21T14:01:28.511977+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:28.511977+0000","last_undegraded":"2024-09-21T14:01:28.511977+0000","last_fullsized":"2024-09-21T14:01:28.511977+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"160'742","reported_seq":19579,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.516090+0000","last_change":"2024-09-21T14:01:07.195832+0000","last_active":"2024-09-21T14:01:28.516090+0000","last_peered":"2024-09-21T14:01:28.516090+0000","last_clean":"2024-09-21T14:01:28.516090+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:28.516090+0000","last_undegraded":"2024-09-21T14:01:28.516090+0000","last_fullsized":"2024-09-21T14:01:28.516090+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"161'433","reported_seq":5958,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.604140+0000","last_change":"2024-09-21T14:01:19.204573+0000","last_active":"2024-09-21T14:01:28.604140+0000","last_peered":"2024-09-21T14:01:28.604140+0000","last_clean":"2024-09-21T14:01:28.604140+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:28.604140+0000","last_undegraded":"2024-09-21T14:01:28.604140+0000","last_fullsized":"2024-09-21T14:01:28.604140+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"159'701","reported_seq":35949,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511843+0000","last_change":"2024-09-21T14:01:17.204986+0000","last_active":"2024-09-21T14:01:28.511843+0000","last_peered":"2024-09-21T14:01:28.511843+0000","last_clean":"2024-09-21T14:01:28.511843+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:28.511843+0000","last_undegraded":"2024-09-21T14:01:28.511843+0000","last_fullsized":"2024-09-21T14:01:28.511843+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"161'415","reported_seq":2180,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.512047+0000","last_change":"2024-09-21T14:01:07.210498+0000","last_active":"2024-09-21T14:01:28.512047+0000","last_peered":"2024-09-21T14:01:28.512047+0000","last_clean":"2024-09-21T14:01:28.512047+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:28.512047+0000","last_undegraded":"2024-09-21T14:01:28.512047+0000","last_fullsized":"2024-09-21T14:01:28.512047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3119,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517928+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:28.517928+0000","last_peered":"2024-09-21T14:01:28.517928+0000","last_clean":"2024-09-21T14:01:28.517928+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:28.517928+0000","last_undegraded":"2024-09-21T14:01:28.517928+0000","last_fullsized":"2024-09-21T14:01:28.517928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3237,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.519883+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.519883+0000","last_peered":"2024-09-21T14:01:28.519883+0000","last_clean":"2024-09-21T14:01:28.519883+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.519883+0000","last_undegraded":"2024-09-21T14:01:28.519883+0000","last_fullsized":"2024-09-21T14:01:28.519883+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:31:26.425145+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"160'414","reported_seq":2267,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517526+0000","last_change":"2024-09-21T14:01:07.196622+0000","last_active":"2024-09-21T14:01:28.517526+0000","last_peered":"2024-09-21T14:01:28.517526+0000","last_clean":"2024-09-21T14:01:28.517526+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:28.517526+0000","last_undegraded":"2024-09-21T14:01:28.517526+0000","last_fullsized":"2024-09-21T14:01:28.517526+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730882+0000","last_change":"2024-09-21T14:00:00.531129+0000","last_active":"2024-09-21T14:01:27.730882+0000","last_peered":"2024-09-21T14:01:27.730882+0000","last_clean":"2024-09-21T14:01:27.730882+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:27.730882+0000","last_undegraded":"2024-09-21T14:01:27.730882+0000","last_fullsized":"2024-09-21T14:01:27.730882+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:07:46.117209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"161'488","reported_seq":2780,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511955+0000","last_change":"2024-09-21T14:01:18.204236+0000","last_active":"2024-09-21T14:01:28.511955+0000","last_peered":"2024-09-21T14:01:28.511955+0000","last_clean":"2024-09-21T14:01:28.511955+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:28.511955+0000","last_undegraded":"2024-09-21T14:01:28.511955+0000","last_fullsized":"2024-09-21T14:01:28.511955+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.604302+0000","last_change":"2024-09-21T14:01:15.398474+0000","last_active":"2024-09-21T14:01:28.604302+0000","last_peered":"2024-09-21T14:01:28.604302+0000","last_clean":"2024-09-21T14:01:28.604302+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:28.604302+0000","last_undegraded":"2024-09-21T14:01:28.604302+0000","last_fullsized":"2024-09-21T14:01:28.604302+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"159'694","reported_seq":5241,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.512018+0000","last_change":"2024-09-21T14:01:18.210880+0000","last_active":"2024-09-21T14:01:28.512018+0000","last_peered":"2024-09-21T14:01:28.512018+0000","last_clean":"2024-09-21T14:01:28.512018+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:28.512018+0000","last_undegraded":"2024-09-21T14:01:28.512018+0000","last_fullsized":"2024-09-21T14:01:28.512018+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509851+0000","last_change":"2024-09-21T14:00:18.284191+0000","last_active":"2024-09-21T14:01:27.509851+0000","last_peered":"2024-09-21T14:01:27.509851+0000","last_clean":"2024-09-21T14:01:27.509851+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:27.509851+0000","last_undegraded":"2024-09-21T14:01:27.509851+0000","last_fullsized":"2024-09-21T14:01:27.509851+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:34:59.401810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"161'972","reported_seq":7360,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.604175+0000","last_change":"2024-09-21T14:01:20.206762+0000","last_active":"2024-09-21T14:01:28.604175+0000","last_peered":"2024-09-21T14:01:28.604175+0000","last_clean":"2024-09-21T14:01:28.604175+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:28.604175+0000","last_undegraded":"2024-09-21T14:01:28.604175+0000","last_fullsized":"2024-09-21T14:01:28.604175+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.668600+0000","last_change":"2024-09-21T14:01:43.668685+0000","last_active":"2024-09-21T14:01:43.668600+0000","last_peered":"2024-09-21T14:01:43.668600+0000","last_clean":"2024-09-21T14:01:43.668600+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:43.668600+0000","last_undegraded":"2024-09-21T14:01:43.668600+0000","last_fullsized":"2024-09-21T14:01:43.668600+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.668563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:25.894901+0000","scrub_duration":0.0014558869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"161'800","reported_seq":20714,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517847+0000","last_change":"2024-09-21T14:01:17.203188+0000","last_active":"2024-09-21T14:01:28.517847+0000","last_peered":"2024-09-21T14:01:28.517847+0000","last_clean":"2024-09-21T14:01:28.517847+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:28.517847+0000","last_undegraded":"2024-09-21T14:01:28.517847+0000","last_fullsized":"2024-09-21T14:01:28.517847+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"161'629","reported_seq":1959,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.518517+0000","last_change":"2024-09-21T14:01:07.196932+0000","last_active":"2024-09-21T14:01:28.518517+0000","last_peered":"2024-09-21T14:01:28.518517+0000","last_clean":"2024-09-21T14:01:28.518517+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:28.518517+0000","last_undegraded":"2024-09-21T14:01:28.518517+0000","last_fullsized":"2024-09-21T14:01:28.518517+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":202,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517262+0000","last_change":"2024-09-21T13:59:36.344041+0000","last_active":"2024-09-21T14:01:28.517262+0000","last_peered":"2024-09-21T14:01:28.517262+0000","last_clean":"2024-09-21T14:01:28.517262+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:28.517262+0000","last_undegraded":"2024-09-21T14:01:28.517262+0000","last_fullsized":"2024-09-21T14:01:28.517262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"159'2588","reported_seq":22241,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.604468+0000","last_change":"2024-09-21T14:01:20.205232+0000","last_active":"2024-09-21T14:01:28.604468+0000","last_peered":"2024-09-21T14:01:28.604468+0000","last_clean":"2024-09-21T14:01:28.604468+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:28.604468+0000","last_undegraded":"2024-09-21T14:01:28.604468+0000","last_fullsized":"2024-09-21T14:01:28.604468+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":2588,"log_dups_size":0,"ondisk_log_size":2588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.512792+0000","last_change":"2024-09-21T14:01:17.196984+0000","last_active":"2024-09-21T14:01:28.512792+0000","last_peered":"2024-09-21T14:01:28.512792+0000","last_clean":"2024-09-21T14:01:28.512792+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:28.512792+0000","last_undegraded":"2024-09-21T14:01:28.512792+0000","last_fullsized":"2024-09-21T14:01:28.512792+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"180'658","reported_seq":5288,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.256347+0000","last_change":"2024-09-21T14:01:43.256499+0000","last_active":"2024-09-21T14:01:43.256347+0000","last_peered":"2024-09-21T14:01:43.256347+0000","last_clean":"2024-09-21T14:01:43.256347+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:43.256347+0000","last_undegraded":"2024-09-21T14:01:43.256347+0000","last_fullsized":"2024-09-21T14:01:43.256347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'658","last_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_deep_scrub":"180'658","last_deep_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.256328+0000","objects_scrubbed":15,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:15.672081+0000","scrub_duration":0.016808792999999999,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":131,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.607065+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:28.607065+0000","last_peered":"2024-09-21T14:01:28.607065+0000","last_clean":"2024-09-21T14:01:28.607065+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:28.607065+0000","last_undegraded":"2024-09-21T14:01:28.607065+0000","last_fullsized":"2024-09-21T14:01:28.607065+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:02.640626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"160'567","reported_seq":20156,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.512038+0000","last_change":"2024-09-21T14:01:16.407267+0000","last_active":"2024-09-21T14:01:28.512038+0000","last_peered":"2024-09-21T14:01:28.512038+0000","last_clean":"2024-09-21T14:01:28.512038+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:28.512038+0000","last_undegraded":"2024-09-21T14:01:28.512038+0000","last_fullsized":"2024-09-21T14:01:28.512038+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":211,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517294+0000","last_change":"2024-09-21T14:01:17.213417+0000","last_active":"2024-09-21T14:01:28.517294+0000","last_peered":"2024-09-21T14:01:28.517294+0000","last_clean":"2024-09-21T14:01:28.517294+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:28.517294+0000","last_undegraded":"2024-09-21T14:01:28.517294+0000","last_fullsized":"2024-09-21T14:01:28.517294+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":297,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509654+0000","last_change":"2024-09-21T14:00:22.183738+0000","last_active":"2024-09-21T14:01:27.509654+0000","last_peered":"2024-09-21T14:01:27.509654+0000","last_clean":"2024-09-21T14:01:27.509654+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:27.509654+0000","last_undegraded":"2024-09-21T14:01:27.509654+0000","last_fullsized":"2024-09-21T14:01:27.509654+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:05.867715+0000","last_clean_scrub_stamp":"2024-09-21T13:58:05.867715+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:52:12.445591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"160'496","reported_seq":3566,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511934+0000","last_change":"2024-09-21T14:01:18.205983+0000","last_active":"2024-09-21T14:01:28.511934+0000","last_peered":"2024-09-21T14:01:28.511934+0000","last_clean":"2024-09-21T14:01:28.511934+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:28.511934+0000","last_undegraded":"2024-09-21T14:01:28.511934+0000","last_fullsized":"2024-09-21T14:01:28.511934+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"159'427","reported_seq":2891,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.516534+0000","last_change":"2024-09-21T14:01:20.208478+0000","last_active":"2024-09-21T14:01:28.516534+0000","last_peered":"2024-09-21T14:01:28.516534+0000","last_clean":"2024-09-21T14:01:28.516534+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:28.516534+0000","last_undegraded":"2024-09-21T14:01:28.516534+0000","last_fullsized":"2024-09-21T14:01:28.516534+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"160'780","reported_seq":16985,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730837+0000","last_change":"2024-09-21T14:01:07.185090+0000","last_active":"2024-09-21T14:01:27.730837+0000","last_peered":"2024-09-21T14:01:27.730837+0000","last_clean":"2024-09-21T14:01:27.730837+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:27.730837+0000","last_undegraded":"2024-09-21T14:01:27.730837+0000","last_fullsized":"2024-09-21T14:01:27.730837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:13:51.745608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"154'568","reported_seq":3985,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511951+0000","last_change":"2024-09-21T14:01:16.408412+0000","last_active":"2024-09-21T14:01:28.511951+0000","last_peered":"2024-09-21T14:01:28.511951+0000","last_clean":"2024-09-21T14:01:28.511951+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:28.511951+0000","last_undegraded":"2024-09-21T14:01:28.511951+0000","last_fullsized":"2024-09-21T14:01:28.511951+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"152'556","reported_seq":4211,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517638+0000","last_change":"2024-09-21T14:01:17.203073+0000","last_active":"2024-09-21T14:01:28.517638+0000","last_peered":"2024-09-21T14:01:28.517638+0000","last_clean":"2024-09-21T14:01:28.517638+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:28.517638+0000","last_undegraded":"2024-09-21T14:01:28.517638+0000","last_fullsized":"2024-09-21T14:01:28.517638+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4992,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524304+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.524304+0000","last_peered":"2024-09-21T14:01:28.524304+0000","last_clean":"2024-09-21T14:01:28.524304+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.524304+0000","last_undegraded":"2024-09-21T14:01:28.524304+0000","last_fullsized":"2024-09-21T14:01:28.524304+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:41:47.557299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"159'568","reported_seq":7982,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.510164+0000","last_change":"2024-09-21T14:01:07.191674+0000","last_active":"2024-09-21T14:01:27.510164+0000","last_peered":"2024-09-21T14:01:27.510164+0000","last_clean":"2024-09-21T14:01:27.510164+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:01:27.510164+0000","last_undegraded":"2024-09-21T14:01:27.510164+0000","last_fullsized":"2024-09-21T14:01:27.510164+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:55:55.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5610,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.511995+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:27.511995+0000","last_peered":"2024-09-21T14:01:27.511995+0000","last_clean":"2024-09-21T14:01:27.511995+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:27.511995+0000","last_undegraded":"2024-09-21T14:01:27.511995+0000","last_fullsized":"2024-09-21T14:01:27.511995+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:14.401996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"159'654","reported_seq":4857,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.730775+0000","last_change":"2024-09-21T14:01:07.185087+0000","last_active":"2024-09-21T14:01:27.730775+0000","last_peered":"2024-09-21T14:01:27.730775+0000","last_clean":"2024-09-21T14:01:27.730775+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:27.730775+0000","last_undegraded":"2024-09-21T14:01:27.730775+0000","last_fullsized":"2024-09-21T14:01:27.730775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:41:59.938361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4074,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524413+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.524413+0000","last_peered":"2024-09-21T14:01:28.524413+0000","last_clean":"2024-09-21T14:01:28.524413+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.524413+0000","last_undegraded":"2024-09-21T14:01:28.524413+0000","last_fullsized":"2024-09-21T14:01:28.524413+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:57:23.323447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"160'1003","reported_seq":4994,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.511534+0000","last_change":"2024-09-21T14:01:07.208643+0000","last_active":"2024-09-21T14:01:28.511534+0000","last_peered":"2024-09-21T14:01:28.511534+0000","last_clean":"2024-09-21T14:01:28.511534+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:28.511534+0000","last_undegraded":"2024-09-21T14:01:28.511534+0000","last_fullsized":"2024-09-21T14:01:28.511534+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"161'416","reported_seq":1679,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-21T14:01:27.509712+0000","last_change":"2024-09-21T14:01:07.191781+0000","last_active":"2024-09-21T14:01:27.509712+0000","last_peered":"2024-09-21T14:01:27.509712+0000","last_clean":"2024-09-21T14:01:27.509712+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:01:27.509712+0000","last_undegraded":"2024-09-21T14:01:27.509712+0000","last_fullsized":"2024-09-21T14:01:27.509712+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:44:48.950723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21398,"ondisk_log_size":21398,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925847,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.05}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.88500000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.98999999999999999}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.89800000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.93700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94298408,"statfs":{"total":96636764160,"available":96561569792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":73005511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79400000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.65800000000000003}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.501}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.59399999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.91800000000000004}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.97999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59484,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312356,"statfs":{"total":96636764160,"available":96575852544,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.77100000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.64300000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.96699999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":0.88600000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.095}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.008},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.2589999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.88800000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":0.63900000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.141},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.85799999999999998}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.61199999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.748},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.96999999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.018}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.0980000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47192,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324648,"statfs":{"total":96636764160,"available":96588439552,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":46135752},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.29799999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.378},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.80800000000000005}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.62},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.86799999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":0.88100000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.77300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574897,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.68100000000000005}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.82199999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":0.92500000000000004}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.73699999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.871},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.01}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":0.90100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41440,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330400,"statfs":{"total":96636764160,"available":96594329600,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.81499999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.68899999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":0.95599999999999996}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":0.91400000000000003}]},{"osd":7,"last update":"Sat Sep 21 14:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":1.012},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":1.1739999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.56399999999999995}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.623},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.44600000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76900000000000002}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.198}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":1.26}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":1.0309999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":1.123}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.592 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.593 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.594 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T13:58:05.867715+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=5, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.595 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.596 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.596 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.596 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:01:45.596 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T14:02:05.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:02:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:02:05.910 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:02:05.926 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-09-21T14:02:05.191757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21943,"ondisk_log_size":21943,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":450008,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":431782,"kb_avail":754524712,"statfs":{"total":773094113280,"available":772633305088,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":442145779},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003818"},"pg_stats":[{"pgid":"3.1f","version":"180'436","reported_seq":3134,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.203676+0000","last_change":"2024-09-21T14:01:59.203994+0000","last_active":"2024-09-21T14:01:59.203676+0000","last_peered":"2024-09-21T14:01:59.203676+0000","last_clean":"2024-09-21T14:01:59.203676+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:59.203676+0000","last_undegraded":"2024-09-21T14:01:59.203676+0000","last_fullsized":"2024-09-21T14:01:59.203676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.203596+0000","objects_scrubbed":15,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:35:56.186557+0000","scrub_duration":0.025858689000000001,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"160'989","reported_seq":18922,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517393+0000","last_change":"2024-09-21T14:01:07.201655+0000","last_active":"2024-09-21T14:01:28.517393+0000","last_peered":"2024-09-21T14:01:28.517393+0000","last_clean":"2024-09-21T14:01:28.517393+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:01:28.517393+0000","last_undegraded":"2024-09-21T14:01:28.517393+0000","last_fullsized":"2024-09-21T14:01:28.517393+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":989,"log_dups_size":0,"ondisk_log_size":989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"160'866","reported_seq":7429,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517610+0000","last_change":"2024-09-21T14:01:07.199770+0000","last_active":"2024-09-21T14:01:28.517610+0000","last_peered":"2024-09-21T14:01:28.517610+0000","last_clean":"2024-09-21T14:01:28.517610+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:01:28.517610+0000","last_undegraded":"2024-09-21T14:01:28.517610+0000","last_fullsized":"2024-09-21T14:01:28.517610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"161'591","reported_seq":4518,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517401+0000","last_change":"2024-09-21T14:01:07.198838+0000","last_active":"2024-09-21T14:01:28.517401+0000","last_peered":"2024-09-21T14:01:28.517401+0000","last_clean":"2024-09-21T14:01:28.517401+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:01:28.517401+0000","last_undegraded":"2024-09-21T14:01:28.517401+0000","last_fullsized":"2024-09-21T14:01:28.517401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"180'447","reported_seq":1981,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:57.262502+0000","last_change":"2024-09-21T14:01:57.262840+0000","last_active":"2024-09-21T14:01:57.262502+0000","last_peered":"2024-09-21T14:01:57.262502+0000","last_clean":"2024-09-21T14:01:57.262502+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:57.262502+0000","last_undegraded":"2024-09-21T14:01:57.262502+0000","last_fullsized":"2024-09-21T14:01:57.262502+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'447","last_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_deep_scrub":"180'447","last_deep_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_clean_scrub_stamp":"2024-09-21T14:01:57.262445+0000","objects_scrubbed":21,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:38.983514+0000","scrub_duration":0.032095513999999999,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'760","reported_seq":19608,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.177216+0000","last_change":"2024-09-21T14:01:50.177442+0000","last_active":"2024-09-21T14:01:50.177216+0000","last_peered":"2024-09-21T14:01:50.177216+0000","last_clean":"2024-09-21T14:01:50.177216+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:50.177216+0000","last_undegraded":"2024-09-21T14:01:50.177216+0000","last_fullsized":"2024-09-21T14:01:50.177216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'760","last_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_deep_scrub":"180'760","last_deep_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.177150+0000","objects_scrubbed":18,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:05.314784+0000","scrub_duration":0.030104995999999998,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"180'453","reported_seq":5989,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.716499+0000","last_change":"2024-09-21T14:01:50.716820+0000","last_active":"2024-09-21T14:01:50.716499+0000","last_peered":"2024-09-21T14:01:50.716499+0000","last_clean":"2024-09-21T14:01:50.716499+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:50.716499+0000","last_undegraded":"2024-09-21T14:01:50.716499+0000","last_fullsized":"2024-09-21T14:01:50.716499+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'453","last_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_deep_scrub":"180'453","last_deep_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.716441+0000","objects_scrubbed":20,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:51.139810+0000","scrub_duration":0.030627534000000001,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"180'719","reported_seq":35978,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:52.888232+0000","last_change":"2024-09-21T14:01:52.888563+0000","last_active":"2024-09-21T14:01:52.888232+0000","last_peered":"2024-09-21T14:01:52.888232+0000","last_clean":"2024-09-21T14:01:52.888232+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:52.888232+0000","last_undegraded":"2024-09-21T14:01:52.888232+0000","last_fullsized":"2024-09-21T14:01:52.888232+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'719","last_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_deep_scrub":"180'719","last_deep_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_clean_scrub_stamp":"2024-09-21T14:01:52.888176+0000","objects_scrubbed":18,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:56:08.359640+0000","scrub_duration":0.034063126999999999,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"180'432","reported_seq":2208,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.250261+0000","last_change":"2024-09-21T14:01:58.250447+0000","last_active":"2024-09-21T14:01:58.250261+0000","last_peered":"2024-09-21T14:01:58.250261+0000","last_clean":"2024-09-21T14:01:58.250261+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:58.250261+0000","last_undegraded":"2024-09-21T14:01:58.250261+0000","last_fullsized":"2024-09-21T14:01:58.250261+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'432","last_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_deep_scrub":"180'432","last_deep_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.250229+0000","objects_scrubbed":17,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:50:13.549945+0000","scrub_duration":0.024698100000000001,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"157'572","reported_seq":3119,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.517928+0000","last_change":"2024-09-21T14:01:07.200655+0000","last_active":"2024-09-21T14:01:28.517928+0000","last_peered":"2024-09-21T14:01:28.517928+0000","last_clean":"2024-09-21T14:01:28.517928+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:01:28.517928+0000","last_undegraded":"2024-09-21T14:01:28.517928+0000","last_fullsized":"2024-09-21T14:01:28.517928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":572,"log_dups_size":0,"ondisk_log_size":572,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"160'528","reported_seq":3238,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.524027+0000","last_change":"2024-09-21T14:01:28.519883+0000","last_active":"2024-09-21T14:01:28.524027+0000","last_peered":"2024-09-21T14:01:28.524027+0000","last_clean":"2024-09-21T14:01:28.524027+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:01:28.524027+0000","last_undegraded":"2024-09-21T14:01:28.524027+0000","last_fullsized":"2024-09-21T14:01:28.524027+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"180'436","reported_seq":2300,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:51.226164+0000","last_change":"2024-09-21T14:01:51.226462+0000","last_active":"2024-09-21T14:01:51.226164+0000","last_peered":"2024-09-21T14:01:51.226164+0000","last_clean":"2024-09-21T14:01:51.226164+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:51.226164+0000","last_undegraded":"2024-09-21T14:01:51.226164+0000","last_fullsized":"2024-09-21T14:01:51.226164+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_clean_scrub_stamp":"2024-09-21T14:01:51.226108+0000","objects_scrubbed":22,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:44.247530+0000","scrub_duration":0.03787227,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.536266+0000","last_change":"2024-09-21T14:01:46.536540+0000","last_active":"2024-09-21T14:01:46.536266+0000","last_peered":"2024-09-21T14:01:46.536266+0000","last_clean":"2024-09-21T14:01:46.536266+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:46.536266+0000","last_undegraded":"2024-09-21T14:01:46.536266+0000","last_fullsized":"2024-09-21T14:01:46.536266+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.536215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:17:03.834566+0000","scrub_duration":0.003274473,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"180'502","reported_seq":2805,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.258283+0000","last_change":"2024-09-21T14:01:49.258594+0000","last_active":"2024-09-21T14:01:49.258283+0000","last_peered":"2024-09-21T14:01:49.258283+0000","last_clean":"2024-09-21T14:01:49.258283+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:49.258283+0000","last_undegraded":"2024-09-21T14:01:49.258283+0000","last_fullsized":"2024-09-21T14:01:49.258283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'502","last_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_deep_scrub":"180'502","last_deep_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.258223+0000","objects_scrubbed":14,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:36.962931+0000","scrub_duration":0.025900291999999998,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.696315+0000","last_change":"2024-09-21T14:01:48.696555+0000","last_active":"2024-09-21T14:01:48.696315+0000","last_peered":"2024-09-21T14:01:48.696315+0000","last_clean":"2024-09-21T14:01:48.696315+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:48.696315+0000","last_undegraded":"2024-09-21T14:01:48.696315+0000","last_fullsized":"2024-09-21T14:01:48.696315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.696263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:43.430803+0000","scrub_duration":0.0032478950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'720","reported_seq":5280,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.998187+0000","last_change":"2024-09-21T14:01:56.998405+0000","last_active":"2024-09-21T14:01:56.998187+0000","last_peered":"2024-09-21T14:01:56.998187+0000","last_clean":"2024-09-21T14:01:56.998187+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:56.998187+0000","last_undegraded":"2024-09-21T14:01:56.998187+0000","last_fullsized":"2024-09-21T14:01:56.998187+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'720","last_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_deep_scrub":"180'720","last_deep_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.998135+0000","objects_scrubbed":26,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:56.829390+0000","scrub_duration":0.043121674999999998,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.844732+0000","last_change":"2024-09-21T14:01:59.844908+0000","last_active":"2024-09-21T14:01:59.844732+0000","last_peered":"2024-09-21T14:01:59.844732+0000","last_clean":"2024-09-21T14:01:59.844732+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:59.844732+0000","last_undegraded":"2024-09-21T14:01:59.844732+0000","last_fullsized":"2024-09-21T14:01:59.844732+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.844693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:26.069899+0000","scrub_duration":0.0031788620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'988","reported_seq":7387,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.731273+0000","last_change":"2024-09-21T14:01:47.731535+0000","last_active":"2024-09-21T14:01:47.731273+0000","last_peered":"2024-09-21T14:01:47.731273+0000","last_clean":"2024-09-21T14:01:47.731273+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:47.731273+0000","last_undegraded":"2024-09-21T14:01:47.731273+0000","last_fullsized":"2024-09-21T14:01:47.731273+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'988","last_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_deep_scrub":"180'988","last_deep_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.731216+0000","objects_scrubbed":16,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:53.053542+0000","scrub_duration":0.029781637999999999,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.668600+0000","last_change":"2024-09-21T14:01:43.668685+0000","last_active":"2024-09-21T14:01:43.668600+0000","last_peered":"2024-09-21T14:01:43.668600+0000","last_clean":"2024-09-21T14:01:43.668600+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:43.668600+0000","last_undegraded":"2024-09-21T14:01:43.668600+0000","last_fullsized":"2024-09-21T14:01:43.668600+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.668563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:25.894901+0000","scrub_duration":0.0014558869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"180'817","reported_seq":20742,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:53.805633+0000","last_change":"2024-09-21T14:01:53.805913+0000","last_active":"2024-09-21T14:01:53.805633+0000","last_peered":"2024-09-21T14:01:53.805633+0000","last_clean":"2024-09-21T14:01:53.805633+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:53.805633+0000","last_undegraded":"2024-09-21T14:01:53.805633+0000","last_fullsized":"2024-09-21T14:01:53.805633+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'817","last_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_deep_scrub":"180'817","last_deep_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_clean_scrub_stamp":"2024-09-21T14:01:53.805581+0000","objects_scrubbed":17,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:37:59.565397+0000","scrub_duration":0.036104471999999999,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"180'649","reported_seq":1990,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.152574+0000","last_change":"2024-09-21T14:01:46.152843+0000","last_active":"2024-09-21T14:01:46.152574+0000","last_peered":"2024-09-21T14:01:46.152574+0000","last_clean":"2024-09-21T14:01:46.152574+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:46.152574+0000","last_undegraded":"2024-09-21T14:01:46.152574+0000","last_fullsized":"2024-09-21T14:01:46.152574+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'649","last_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_deep_scrub":"180'649","last_deep_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.152517+0000","objects_scrubbed":20,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:04.271846+0000","scrub_duration":0.040001257999999998,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"180'3","reported_seq":214,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.762121+0000","last_change":"2024-09-21T14:01:49.762340+0000","last_active":"2024-09-21T14:01:49.762121+0000","last_peered":"2024-09-21T14:01:49.762121+0000","last_clean":"2024-09-21T14:01:49.762121+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:49.762121+0000","last_undegraded":"2024-09-21T14:01:49.762121+0000","last_fullsized":"2024-09-21T14:01:49.762121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'3","last_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_deep_scrub":"180'3","last_deep_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.762070+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:40:22.234496+0000","scrub_duration":0.0059972330000000003,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"180'2609","reported_seq":22273,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.723228+0000","last_change":"2024-09-21T14:01:46.723613+0000","last_active":"2024-09-21T14:01:46.723228+0000","last_peered":"2024-09-21T14:01:46.723228+0000","last_clean":"2024-09-21T14:01:46.723228+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:46.723228+0000","last_undegraded":"2024-09-21T14:01:46.723228+0000","last_fullsized":"2024-09-21T14:01:46.723228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2609","last_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_deep_scrub":"180'2609","last_deep_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.723118+0000","objects_scrubbed":21,"log_size":2609,"log_dups_size":0,"ondisk_log_size":2609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:44:00.977788+0000","scrub_duration":0.053443966000000002,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.512801+0000","last_change":"2024-09-21T14:01:47.513023+0000","last_active":"2024-09-21T14:01:47.512801+0000","last_peered":"2024-09-21T14:01:47.512801+0000","last_clean":"2024-09-21T14:01:47.512801+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:47.512801+0000","last_undegraded":"2024-09-21T14:01:47.512801+0000","last_fullsized":"2024-09-21T14:01:47.512801+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.512730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:28.118655+0000","scrub_duration":0.0028144400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"180'658","reported_seq":5288,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.256347+0000","last_change":"2024-09-21T14:01:43.256499+0000","last_active":"2024-09-21T14:01:43.256347+0000","last_peered":"2024-09-21T14:01:43.256347+0000","last_clean":"2024-09-21T14:01:43.256347+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:43.256347+0000","last_undegraded":"2024-09-21T14:01:43.256347+0000","last_fullsized":"2024-09-21T14:01:43.256347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'658","last_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_deep_scrub":"180'658","last_deep_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.256328+0000","objects_scrubbed":15,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:15.672081+0000","scrub_duration":0.016808792999999999,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:45.274895+0000","last_change":"2024-09-21T14:01:28.607065+0000","last_active":"2024-09-21T14:01:45.274895+0000","last_peered":"2024-09-21T14:01:45.274895+0000","last_clean":"2024-09-21T14:01:45.274895+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:01:45.274895+0000","last_undegraded":"2024-09-21T14:01:45.274895+0000","last_fullsized":"2024-09-21T14:01:45.274895+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:10.922798+0000","last_clean_scrub_stamp":"2024-09-21T13:58:10.922798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"180'588","reported_seq":20188,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.816927+0000","last_change":"2024-09-21T14:01:48.817199+0000","last_active":"2024-09-21T14:01:48.816927+0000","last_peered":"2024-09-21T14:01:48.816927+0000","last_clean":"2024-09-21T14:01:48.816927+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:48.816927+0000","last_undegraded":"2024-09-21T14:01:48.816927+0000","last_fullsized":"2024-09-21T14:01:48.816927+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'588","last_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_deep_scrub":"180'588","last_deep_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.816853+0000","objects_scrubbed":21,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:40:26.788018+0000","scrub_duration":0.030963671000000002,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"180'2","reported_seq":223,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.761656+0000","last_change":"2024-09-21T14:01:47.761874+0000","last_active":"2024-09-21T14:01:47.761656+0000","last_peered":"2024-09-21T14:01:47.761656+0000","last_clean":"2024-09-21T14:01:47.761656+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:47.761656+0000","last_undegraded":"2024-09-21T14:01:47.761656+0000","last_fullsized":"2024-09-21T14:01:47.761656+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2","last_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_deep_scrub":"180'2","last_deep_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.761603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:41.636595+0000","scrub_duration":0.0057674420000000002,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"180'119","reported_seq":312,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.865787+0000","last_change":"2024-09-21T14:01:58.865787+0000","last_active":"2024-09-21T14:01:58.865787+0000","last_peered":"2024-09-21T14:01:58.865787+0000","last_clean":"2024-09-21T14:01:58.865787+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:58.865787+0000","last_undegraded":"2024-09-21T14:01:58.865787+0000","last_fullsized":"2024-09-21T14:01:58.865787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'119","last_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_deep_scrub":"180'119","last_deep_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.865623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:25.334431+0000","scrub_duration":0.0077650449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"180'513","reported_seq":3594,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:55.976923+0000","last_change":"2024-09-21T14:01:55.977149+0000","last_active":"2024-09-21T14:01:55.976923+0000","last_peered":"2024-09-21T14:01:55.976923+0000","last_clean":"2024-09-21T14:01:55.976923+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:55.976923+0000","last_undegraded":"2024-09-21T14:01:55.976923+0000","last_fullsized":"2024-09-21T14:01:55.976923+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'513","last_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_deep_scrub":"180'513","last_deep_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_clean_scrub_stamp":"2024-09-21T14:01:55.976864+0000","objects_scrubbed":17,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:01.102938+0000","scrub_duration":0.02808488,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"180'440","reported_seq":2915,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.171550+0000","last_change":"2024-09-21T14:01:49.171810+0000","last_active":"2024-09-21T14:01:49.171550+0000","last_peered":"2024-09-21T14:01:49.171550+0000","last_clean":"2024-09-21T14:01:49.171550+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:49.171550+0000","last_undegraded":"2024-09-21T14:01:49.171550+0000","last_fullsized":"2024-09-21T14:01:49.171550+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'440","last_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_deep_scrub":"180'440","last_deep_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.171491+0000","objects_scrubbed":13,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:39.900224+0000","scrub_duration":0.020734200000000001,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"180'808","reported_seq":17027,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.660887+0000","last_change":"2024-09-21T14:01:50.661094+0000","last_active":"2024-09-21T14:01:50.660887+0000","last_peered":"2024-09-21T14:01:50.660887+0000","last_clean":"2024-09-21T14:01:50.660887+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:50.660887+0000","last_undegraded":"2024-09-21T14:01:50.660887+0000","last_fullsized":"2024-09-21T14:01:50.660887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'808","last_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_deep_scrub":"180'808","last_deep_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.660835+0000","objects_scrubbed":28,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:06.622117+0000","scrub_duration":0.050819949000000003,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"180'584","reported_seq":4012,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.820758+0000","last_change":"2024-09-21T14:01:49.821009+0000","last_active":"2024-09-21T14:01:49.820758+0000","last_peered":"2024-09-21T14:01:49.820758+0000","last_clean":"2024-09-21T14:01:49.820758+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:49.820758+0000","last_undegraded":"2024-09-21T14:01:49.820758+0000","last_fullsized":"2024-09-21T14:01:49.820758+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'584","last_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_deep_scrub":"180'584","last_deep_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.820705+0000","objects_scrubbed":16,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:29.221232+0000","scrub_duration":0.028617111000000001,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"180'575","reported_seq":4241,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.801657+0000","last_change":"2024-09-21T14:01:56.801780+0000","last_active":"2024-09-21T14:01:56.801657+0000","last_peered":"2024-09-21T14:01:56.801657+0000","last_clean":"2024-09-21T14:01:56.801657+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:56.801657+0000","last_undegraded":"2024-09-21T14:01:56.801657+0000","last_fullsized":"2024-09-21T14:01:56.801657+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'575","last_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_deep_scrub":"180'575","last_deep_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.801631+0000","objects_scrubbed":19,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:56:00.843359+0000","scrub_duration":0.026441732999999999,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4993,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.526158+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:28.526158+0000","last_peered":"2024-09-21T14:01:28.526158+0000","last_clean":"2024-09-21T14:01:28.526158+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:28.526158+0000","last_undegraded":"2024-09-21T14:01:28.526158+0000","last_fullsized":"2024-09-21T14:01:28.526158+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"180'583","reported_seq":8009,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:01.913588+0000","last_change":"2024-09-21T14:02:01.913882+0000","last_active":"2024-09-21T14:02:01.913588+0000","last_peered":"2024-09-21T14:02:01.913588+0000","last_clean":"2024-09-21T14:02:01.913588+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:02:01.913588+0000","last_undegraded":"2024-09-21T14:02:01.913588+0000","last_fullsized":"2024-09-21T14:02:01.913588+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'583","last_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_deep_scrub":"180'583","last_deep_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_clean_scrub_stamp":"2024-09-21T14:02:01.913534+0000","objects_scrubbed":15,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:16:30.074136+0000","scrub_duration":0.027399421,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"161'672","reported_seq":5611,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.513096+0000","last_change":"2024-09-21T14:01:07.192567+0000","last_active":"2024-09-21T14:01:28.513096+0000","last_peered":"2024-09-21T14:01:28.513096+0000","last_clean":"2024-09-21T14:01:28.513096+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:01:28.513096+0000","last_undegraded":"2024-09-21T14:01:28.513096+0000","last_fullsized":"2024-09-21T14:01:28.513096+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"180'672","reported_seq":4887,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.643167+0000","last_change":"2024-09-21T14:01:49.643400+0000","last_active":"2024-09-21T14:01:49.643167+0000","last_peered":"2024-09-21T14:01:49.643167+0000","last_clean":"2024-09-21T14:01:49.643167+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:49.643167+0000","last_undegraded":"2024-09-21T14:01:49.643167+0000","last_fullsized":"2024-09-21T14:01:49.643167+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'672","last_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_deep_scrub":"180'672","last_deep_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.643110+0000","objects_scrubbed":18,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:36:49.695799+0000","scrub_duration":0.028678182999999999,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"161'324","reported_seq":4075,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:28.526206+0000","last_change":"2024-09-21T14:01:28.524413+0000","last_active":"2024-09-21T14:01:28.526206+0000","last_peered":"2024-09-21T14:01:28.526206+0000","last_clean":"2024-09-21T14:01:28.526206+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:01:28.526206+0000","last_undegraded":"2024-09-21T14:01:28.526206+0000","last_fullsized":"2024-09-21T14:01:28.526206+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"180'1019","reported_seq":5021,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.213029+0000","last_change":"2024-09-21T14:01:48.213291+0000","last_active":"2024-09-21T14:01:48.213029+0000","last_peered":"2024-09-21T14:01:48.213029+0000","last_clean":"2024-09-21T14:01:48.213029+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:48.213029+0000","last_undegraded":"2024-09-21T14:01:48.213029+0000","last_fullsized":"2024-09-21T14:01:48.213029+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'1019","last_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_deep_scrub":"180'1019","last_deep_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.212975+0000","objects_scrubbed":16,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:55:31.897590+0000","scrub_duration":0.028793046999999999,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"180'429","reported_seq":1704,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:00.902319+0000","last_change":"2024-09-21T14:02:00.902567+0000","last_active":"2024-09-21T14:02:00.902319+0000","last_peered":"2024-09-21T14:02:00.902319+0000","last_clean":"2024-09-21T14:02:00.902319+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:02:00.902319+0000","last_undegraded":"2024-09-21T14:02:00.902319+0000","last_fullsized":"2024-09-21T14:02:00.902319+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'429","last_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_deep_scrub":"180'429","last_deep_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_clean_scrub_stamp":"2024-09-21T14:02:00.902263+0000","objects_scrubbed":13,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:34.904723+0000","scrub_duration":0.022654962000000001,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21819,"ondisk_log_size":21819,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925851,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.94099999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":1.071}]},{"osd":2,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.004}]},{"osd":3,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.048},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.167}]},{"osd":4,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":1.1240000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":1.1000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77520,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294320,"statfs":{"total":96636764160,"available":96557383680,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77199815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.50600000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.028,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.75700000000000001,"15min":0.77300000000000002},"min":{"1min":0.51400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.4219999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.88400000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.69699999999999995,"15min":0.67800000000000005},"min":{"1min":0.504,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.99199999999999999},"min":{"1min":0.53300000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.3580000000000001,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":1.0549999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3520000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.89500000000000002},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.385,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.036}]},{"osd":3,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88100000000000001,"15min":0.90000000000000002},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.284,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.081},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.306,"5min":1.367,"15min":1.367},"last":0.92400000000000004}]},{"osd":4,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.84199999999999997,"15min":0.872},"min":{"1min":0.30499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.628},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.99199999999999999},"min":{"1min":0.36899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2350000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.92000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.228,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.91600000000000004,"15min":0.94799999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.157,"5min":1.403,"15min":1.403},"last":0.94899999999999995}]},{"osd":7,"last update":"Sat Sep 21 14:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":4.976,"5min":4.976,"15min":4.976},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59476,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312364,"statfs":{"total":96636764160,"available":96575860736,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.30299999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1839999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.72499999999999998},"min":{"1min":0.44900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.879}]},{"osd":1,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80500000000000005,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.1519999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.21},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.75600000000000001,"15min":0.77200000000000002},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.2090000000000001,"5min":1.351,"15min":1.351},"last":0.79200000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82299999999999995,"15min":0.83999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2350000000000001,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.40400000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.9690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.0580000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0609999999999999,"5min":1.579,"15min":1.579},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":1.0940000000000001,"15min":1.1910000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.0760000000000001,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":0.98299999999999998}]},{"osd":4,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.36699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.3220000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.35899999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.1950000000000001,"5min":1.421,"15min":1.421},"last":1.1319999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.89000000000000001,"15min":0.90700000000000003},"min":{"1min":0.38700000000000001,"5min":0.312,"15min":0.312},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.107},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89100000000000001,"15min":0.90300000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0149999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.96099999999999997,"15min":0.94199999999999995},"min":{"1min":0.85199999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.522,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.28},{"interface":"front","average":{"1min":1.099,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.80700000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6439999999999999,"5min":2.222,"15min":2.222},"last":1.157}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.48599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0660000000000001,"5min":1.274,"15min":1.274},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.89600000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.2609999999999999,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.8819999999999999,"15min":2.423},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.276,"5min":39.390000000000001,"15min":39.390000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.81999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1040000000000001,"5min":1.528,"15min":1.528},"last":0.89900000000000002}]},{"osd":2,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.84299999999999997,"15min":0.86299999999999999},"min":{"1min":0.442,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1000000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.056},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.2310000000000001,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.91100000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":1.115,"15min":1.2549999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0389999999999999,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.76000000000000001,"5min":2.206,"15min":2.8439999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.97799999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.85599999999999998,"15min":0.88600000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.286,"5min":1.476,"15min":1.476},"last":0.625},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.51300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.272,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.274}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":1.881,"15min":2.375},"min":{"1min":0.49199999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.998,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.91900000000000004,"15min":0.95099999999999996},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1839999999999999,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.034}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.77700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.3280000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.202,"5min":0.97899999999999998,"15min":0.94199999999999995},"min":{"1min":0.89200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6259999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.3120000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51280,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320560,"statfs":{"total":96636764160,"available":96584253440,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.23999999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.1839999999999999,"5min":1.873,"15min":1.873},"last":0.70799999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.85899999999999999,"15min":0.78100000000000003},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.131,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.52400000000000002},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.753}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.626,"15min":0.628},"min":{"1min":0.318,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.96399999999999997,"15min":0.88800000000000001},"min":{"1min":0.36199999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.3120000000000001,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.90100000000000002}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":1,"15min":0.90300000000000002},"min":{"1min":0.48599999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1180000000000001,"5min":22.210999999999999,"15min":22.210999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.90200000000000002,"15min":0.92700000000000005},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.077,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.872}]},{"osd":5,"last update":"Sat Sep 21 14:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.92000000000000004,"15min":0.98799999999999999},"min":{"1min":0.53400000000000003,"5min":0.378,"15min":0.378},"max":{"1min":1.212,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.85999999999999999,"15min":0.89800000000000002},"min":{"1min":0.45300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0940000000000001,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.97099999999999997}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.163,"15min":1.091},"min":{"1min":0.56499999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.1789999999999998,"5min":22.157,"15min":22.157},"last":1.181},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.90800000000000003,"15min":0.92400000000000004},"min":{"1min":0.61099999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.145,"5min":2.641,"15min":2.641},"last":1.202}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.91900000000000004,"15min":0.90300000000000002},"min":{"1min":0.65700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.90700000000000003,"15min":0.88100000000000001},"min":{"1min":0.70599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.1180000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67800000000000005,"15min":0.69599999999999995},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.9039999999999999,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.67700000000000005}]},{"osd":1,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.66600000000000004,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.77300000000000002,"15min":0.76900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.3550000000000004,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.81899999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":1.2350000000000001,"15min":1.425},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.4989999999999997,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.2709999999999999,"15min":1.4850000000000001},"min":{"1min":0.40300000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.252,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.89800000000000002,"15min":0.92400000000000004},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":1.579,"5min":1.609,"15min":1.609},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":1.1259999999999999,"15min":1.246},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.2490000000000001,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.05}]},{"osd":5,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.874,"15min":0.873},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":3.4500000000000002,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.90400000000000003,"15min":0.92400000000000004},"min":{"1min":0.45600000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.4530000000000001,"5min":1.534,"15min":1.534},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Sep 21 14:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94799999999999995,"15min":0.96799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.1669999999999998,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.5760000000000001,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.0229999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6339999999999999,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0489999999999999,"15min":1.056},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2829999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.085}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.249,"5min":0.223,"15min":0.223},"max":{"1min":1.0780000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.66200000000000003},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.2070000000000001,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.28899999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0489999999999999,"5min":1.157,"15min":1.157},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.147,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.90900000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.29499999999999998,"5min":0.221,"15min":0.221},"max":{"1min":1.0369999999999999,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":1.1060000000000001,"15min":1.3380000000000001},"min":{"1min":0.30499999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.0589999999999999,"5min":13.083,"15min":13.083},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.46500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.2430000000000001,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84299999999999997,"15min":0.84099999999999997},"min":{"1min":0.45200000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.1040000000000001,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.0629999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83099999999999996,"15min":0.84999999999999998},"min":{"1min":0.46200000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.6020000000000001,"5min":1.732,"15min":1.732},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.175,"5min":1.468,"15min":1.468},"last":1.002}]},{"osd":6,"last update":"Sat Sep 21 14:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.54500000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.21,"5min":1.552,"15min":1.552},"last":1.038},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.96099999999999997,"15min":1.0029999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2509999999999999,"5min":2.48,"15min":2.48},"last":1.163}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":0.91900000000000004,"15min":0.88700000000000001},"min":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.036,"5min":0.88600000000000001,"15min":0.86099999999999999},"min":{"1min":0.80300000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2190000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.24299999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.89400000000000002,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.92800000000000005,"5min":1.206,"15min":1.206},"last":0.60399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.71199999999999997,"15min":0.78200000000000003},"min":{"1min":0.29299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.0029999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.86799999999999999,"15min":0.999},"min":{"1min":0.33000000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.874,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.92500000000000004,"15min":1.087},"min":{"1min":0.34300000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.054,"5min":11.84,"15min":11.84},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.69899999999999995,"15min":0.73999999999999999},"min":{"1min":0.309,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.91700000000000004,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.86199999999999999,"15min":0.90300000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1519999999999999,"5min":1.647,"15min":1.647},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.84599999999999997,"15min":0.88},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0620000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":0.85499999999999998},"min":{"1min":0.50700000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.996,"15min":1.0609999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":1.109}]},{"osd":6,"last update":"Sat Sep 21 14:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.0249999999999999,"15min":1.0900000000000001},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4199999999999999,"5min":4.2859999999999996,"15min":4.2859999999999996},"last":1.163},{"interface":"front","average":{"1min":0.872,"5min":0.89900000000000002,"15min":0.92500000000000004},"min":{"1min":0.54200000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1739999999999999,"5min":1.409,"15min":1.409},"last":1.1419999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.21}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:02:05.929 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.929 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.929 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.930 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.930 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.930 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T13:58:10.922798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=10, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.930 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.930 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.931 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:05.931 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T14:02:25.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:02:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:02:26.249 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:02:26.266 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-21T14:02:25.197968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22077,"ondisk_log_size":22077,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":450008,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":431782,"kb_avail":754524712,"statfs":{"total":773094113280,"available":772633305088,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":442145779},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003685"},"pg_stats":[{"pgid":"3.1f","version":"180'436","reported_seq":3134,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.203676+0000","last_change":"2024-09-21T14:01:59.203994+0000","last_active":"2024-09-21T14:01:59.203676+0000","last_peered":"2024-09-21T14:01:59.203676+0000","last_clean":"2024-09-21T14:01:59.203676+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:59.203676+0000","last_undegraded":"2024-09-21T14:01:59.203676+0000","last_fullsized":"2024-09-21T14:01:59.203676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.203596+0000","objects_scrubbed":15,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:35:56.186557+0000","scrub_duration":0.025858689000000001,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"180'1003","reported_seq":18947,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:09.759125+0000","last_change":"2024-09-21T14:02:09.759403+0000","last_active":"2024-09-21T14:02:09.759125+0000","last_peered":"2024-09-21T14:02:09.759125+0000","last_clean":"2024-09-21T14:02:09.759125+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:02:09.759125+0000","last_undegraded":"2024-09-21T14:02:09.759125+0000","last_fullsized":"2024-09-21T14:02:09.759125+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'1003","last_scrub_stamp":"2024-09-21T14:02:09.759072+0000","last_deep_scrub":"180'1003","last_deep_scrub_stamp":"2024-09-21T14:02:09.759072+0000","last_clean_scrub_stamp":"2024-09-21T14:02:09.759072+0000","objects_scrubbed":14,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:09.994891+0000","scrub_duration":0.029909120000000001,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"180'885","reported_seq":7459,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:06.743850+0000","last_change":"2024-09-21T14:02:06.744193+0000","last_active":"2024-09-21T14:02:06.743850+0000","last_peered":"2024-09-21T14:02:06.743850+0000","last_clean":"2024-09-21T14:02:06.743850+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:02:06.743850+0000","last_undegraded":"2024-09-21T14:02:06.743850+0000","last_fullsized":"2024-09-21T14:02:06.743850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'885","last_scrub_stamp":"2024-09-21T14:02:06.743799+0000","last_deep_scrub":"180'885","last_deep_scrub_stamp":"2024-09-21T14:02:06.743799+0000","last_clean_scrub_stamp":"2024-09-21T14:02:06.743799+0000","objects_scrubbed":19,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:23:58.951293+0000","scrub_duration":0.040052422999999997,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"180'612","reported_seq":4550,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:07.724038+0000","last_change":"2024-09-21T14:02:07.724302+0000","last_active":"2024-09-21T14:02:07.724038+0000","last_peered":"2024-09-21T14:02:07.724038+0000","last_clean":"2024-09-21T14:02:07.724038+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:02:07.724038+0000","last_undegraded":"2024-09-21T14:02:07.724038+0000","last_fullsized":"2024-09-21T14:02:07.724038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'612","last_scrub_stamp":"2024-09-21T14:02:07.723979+0000","last_deep_scrub":"180'612","last_deep_scrub_stamp":"2024-09-21T14:02:07.723979+0000","last_clean_scrub_stamp":"2024-09-21T14:02:07.723979+0000","objects_scrubbed":21,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:16.930424+0000","scrub_duration":0.037140123999999997,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"180'447","reported_seq":1981,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:57.262502+0000","last_change":"2024-09-21T14:01:57.262840+0000","last_active":"2024-09-21T14:01:57.262502+0000","last_peered":"2024-09-21T14:01:57.262502+0000","last_clean":"2024-09-21T14:01:57.262502+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:57.262502+0000","last_undegraded":"2024-09-21T14:01:57.262502+0000","last_fullsized":"2024-09-21T14:01:57.262502+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'447","last_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_deep_scrub":"180'447","last_deep_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_clean_scrub_stamp":"2024-09-21T14:01:57.262445+0000","objects_scrubbed":21,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:38.983514+0000","scrub_duration":0.032095513999999999,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'760","reported_seq":19608,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.177216+0000","last_change":"2024-09-21T14:01:50.177442+0000","last_active":"2024-09-21T14:01:50.177216+0000","last_peered":"2024-09-21T14:01:50.177216+0000","last_clean":"2024-09-21T14:01:50.177216+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:50.177216+0000","last_undegraded":"2024-09-21T14:01:50.177216+0000","last_fullsized":"2024-09-21T14:01:50.177216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'760","last_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_deep_scrub":"180'760","last_deep_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.177150+0000","objects_scrubbed":18,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:05.314784+0000","scrub_duration":0.030104995999999998,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"180'453","reported_seq":5989,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.716499+0000","last_change":"2024-09-21T14:01:50.716820+0000","last_active":"2024-09-21T14:01:50.716499+0000","last_peered":"2024-09-21T14:01:50.716499+0000","last_clean":"2024-09-21T14:01:50.716499+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:50.716499+0000","last_undegraded":"2024-09-21T14:01:50.716499+0000","last_fullsized":"2024-09-21T14:01:50.716499+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'453","last_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_deep_scrub":"180'453","last_deep_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.716441+0000","objects_scrubbed":20,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:51.139810+0000","scrub_duration":0.030627534000000001,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"180'719","reported_seq":35978,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:52.888232+0000","last_change":"2024-09-21T14:01:52.888563+0000","last_active":"2024-09-21T14:01:52.888232+0000","last_peered":"2024-09-21T14:01:52.888232+0000","last_clean":"2024-09-21T14:01:52.888232+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:52.888232+0000","last_undegraded":"2024-09-21T14:01:52.888232+0000","last_fullsized":"2024-09-21T14:01:52.888232+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'719","last_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_deep_scrub":"180'719","last_deep_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_clean_scrub_stamp":"2024-09-21T14:01:52.888176+0000","objects_scrubbed":18,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:56:08.359640+0000","scrub_duration":0.034063126999999999,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"180'432","reported_seq":2208,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.250261+0000","last_change":"2024-09-21T14:01:58.250447+0000","last_active":"2024-09-21T14:01:58.250261+0000","last_peered":"2024-09-21T14:01:58.250261+0000","last_clean":"2024-09-21T14:01:58.250261+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:58.250261+0000","last_undegraded":"2024-09-21T14:01:58.250261+0000","last_fullsized":"2024-09-21T14:01:58.250261+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'432","last_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_deep_scrub":"180'432","last_deep_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.250229+0000","objects_scrubbed":17,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:50:13.549945+0000","scrub_duration":0.024698100000000001,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"180'596","reported_seq":3154,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:04.803191+0000","last_change":"2024-09-21T14:02:04.803435+0000","last_active":"2024-09-21T14:02:04.803191+0000","last_peered":"2024-09-21T14:02:04.803191+0000","last_clean":"2024-09-21T14:02:04.803191+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:02:04.803191+0000","last_undegraded":"2024-09-21T14:02:04.803191+0000","last_fullsized":"2024-09-21T14:02:04.803191+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'596","last_scrub_stamp":"2024-09-21T14:02:04.803139+0000","last_deep_scrub":"180'596","last_deep_scrub_stamp":"2024-09-21T14:02:04.803139+0000","last_clean_scrub_stamp":"2024-09-21T14:02:04.803139+0000","objects_scrubbed":24,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:27.837444+0000","scrub_duration":0.042309135999999997,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"180'553","reported_seq":3276,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:22.970353+0000","last_change":"2024-09-21T14:02:22.970573+0000","last_active":"2024-09-21T14:02:22.970353+0000","last_peered":"2024-09-21T14:02:22.970353+0000","last_clean":"2024-09-21T14:02:22.970353+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:02:22.970353+0000","last_undegraded":"2024-09-21T14:02:22.970353+0000","last_fullsized":"2024-09-21T14:02:22.970353+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'553","last_scrub_stamp":"2024-09-21T14:02:22.970300+0000","last_deep_scrub":"180'553","last_deep_scrub_stamp":"2024-09-21T14:02:22.970300+0000","last_clean_scrub_stamp":"2024-09-21T14:02:22.970300+0000","objects_scrubbed":25,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:32:12.195252+0000","scrub_duration":0.039876474000000002,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"180'436","reported_seq":2300,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:51.226164+0000","last_change":"2024-09-21T14:01:51.226462+0000","last_active":"2024-09-21T14:01:51.226164+0000","last_peered":"2024-09-21T14:01:51.226164+0000","last_clean":"2024-09-21T14:01:51.226164+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:51.226164+0000","last_undegraded":"2024-09-21T14:01:51.226164+0000","last_fullsized":"2024-09-21T14:01:51.226164+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_clean_scrub_stamp":"2024-09-21T14:01:51.226108+0000","objects_scrubbed":22,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:44.247530+0000","scrub_duration":0.03787227,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.536266+0000","last_change":"2024-09-21T14:01:46.536540+0000","last_active":"2024-09-21T14:01:46.536266+0000","last_peered":"2024-09-21T14:01:46.536266+0000","last_clean":"2024-09-21T14:01:46.536266+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:46.536266+0000","last_undegraded":"2024-09-21T14:01:46.536266+0000","last_fullsized":"2024-09-21T14:01:46.536266+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.536215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:17:03.834566+0000","scrub_duration":0.003274473,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"180'502","reported_seq":2805,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.258283+0000","last_change":"2024-09-21T14:01:49.258594+0000","last_active":"2024-09-21T14:01:49.258283+0000","last_peered":"2024-09-21T14:01:49.258283+0000","last_clean":"2024-09-21T14:01:49.258283+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:49.258283+0000","last_undegraded":"2024-09-21T14:01:49.258283+0000","last_fullsized":"2024-09-21T14:01:49.258283+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'502","last_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_deep_scrub":"180'502","last_deep_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.258223+0000","objects_scrubbed":14,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:36.962931+0000","scrub_duration":0.025900291999999998,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.696315+0000","last_change":"2024-09-21T14:01:48.696555+0000","last_active":"2024-09-21T14:01:48.696315+0000","last_peered":"2024-09-21T14:01:48.696315+0000","last_clean":"2024-09-21T14:01:48.696315+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:48.696315+0000","last_undegraded":"2024-09-21T14:01:48.696315+0000","last_fullsized":"2024-09-21T14:01:48.696315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.696263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:43.430803+0000","scrub_duration":0.0032478950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'720","reported_seq":5280,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.998187+0000","last_change":"2024-09-21T14:01:56.998405+0000","last_active":"2024-09-21T14:01:56.998187+0000","last_peered":"2024-09-21T14:01:56.998187+0000","last_clean":"2024-09-21T14:01:56.998187+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:56.998187+0000","last_undegraded":"2024-09-21T14:01:56.998187+0000","last_fullsized":"2024-09-21T14:01:56.998187+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'720","last_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_deep_scrub":"180'720","last_deep_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.998135+0000","objects_scrubbed":26,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:56.829390+0000","scrub_duration":0.043121674999999998,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.844908+0000","last_change":"2024-09-21T14:01:59.844908+0000","last_active":"2024-09-21T14:01:59.844908+0000","last_peered":"2024-09-21T14:01:59.844908+0000","last_clean":"2024-09-21T14:01:59.844908+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:59.844908+0000","last_undegraded":"2024-09-21T14:01:59.844908+0000","last_fullsized":"2024-09-21T14:01:59.844908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.844693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:26.069899+0000","scrub_duration":0.0031788620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'988","reported_seq":7387,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.731273+0000","last_change":"2024-09-21T14:01:47.731535+0000","last_active":"2024-09-21T14:01:47.731273+0000","last_peered":"2024-09-21T14:01:47.731273+0000","last_clean":"2024-09-21T14:01:47.731273+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:47.731273+0000","last_undegraded":"2024-09-21T14:01:47.731273+0000","last_fullsized":"2024-09-21T14:01:47.731273+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'988","last_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_deep_scrub":"180'988","last_deep_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.731216+0000","objects_scrubbed":16,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:53.053542+0000","scrub_duration":0.029781637999999999,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.668600+0000","last_change":"2024-09-21T14:01:43.668685+0000","last_active":"2024-09-21T14:01:43.668600+0000","last_peered":"2024-09-21T14:01:43.668600+0000","last_clean":"2024-09-21T14:01:43.668600+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:43.668600+0000","last_undegraded":"2024-09-21T14:01:43.668600+0000","last_fullsized":"2024-09-21T14:01:43.668600+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.668563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:25.894901+0000","scrub_duration":0.0014558869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"180'817","reported_seq":20742,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:53.805633+0000","last_change":"2024-09-21T14:01:53.805913+0000","last_active":"2024-09-21T14:01:53.805633+0000","last_peered":"2024-09-21T14:01:53.805633+0000","last_clean":"2024-09-21T14:01:53.805633+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:53.805633+0000","last_undegraded":"2024-09-21T14:01:53.805633+0000","last_fullsized":"2024-09-21T14:01:53.805633+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'817","last_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_deep_scrub":"180'817","last_deep_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_clean_scrub_stamp":"2024-09-21T14:01:53.805581+0000","objects_scrubbed":17,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:37:59.565397+0000","scrub_duration":0.036104471999999999,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"180'649","reported_seq":1990,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.152574+0000","last_change":"2024-09-21T14:01:46.152843+0000","last_active":"2024-09-21T14:01:46.152574+0000","last_peered":"2024-09-21T14:01:46.152574+0000","last_clean":"2024-09-21T14:01:46.152574+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:46.152574+0000","last_undegraded":"2024-09-21T14:01:46.152574+0000","last_fullsized":"2024-09-21T14:01:46.152574+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'649","last_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_deep_scrub":"180'649","last_deep_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.152517+0000","objects_scrubbed":20,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:04.271846+0000","scrub_duration":0.040001257999999998,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"180'3","reported_seq":215,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.762340+0000","last_change":"2024-09-21T14:01:49.762340+0000","last_active":"2024-09-21T14:01:49.762340+0000","last_peered":"2024-09-21T14:01:49.762340+0000","last_clean":"2024-09-21T14:01:49.762340+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:49.762340+0000","last_undegraded":"2024-09-21T14:01:49.762340+0000","last_fullsized":"2024-09-21T14:01:49.762340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'3","last_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_deep_scrub":"180'3","last_deep_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.762070+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:40:22.234496+0000","scrub_duration":0.0059972330000000003,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"180'2609","reported_seq":22273,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.723228+0000","last_change":"2024-09-21T14:01:46.723613+0000","last_active":"2024-09-21T14:01:46.723228+0000","last_peered":"2024-09-21T14:01:46.723228+0000","last_clean":"2024-09-21T14:01:46.723228+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:46.723228+0000","last_undegraded":"2024-09-21T14:01:46.723228+0000","last_fullsized":"2024-09-21T14:01:46.723228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2609","last_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_deep_scrub":"180'2609","last_deep_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.723118+0000","objects_scrubbed":21,"log_size":2609,"log_dups_size":0,"ondisk_log_size":2609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:44:00.977788+0000","scrub_duration":0.053443966000000002,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.512801+0000","last_change":"2024-09-21T14:01:47.513023+0000","last_active":"2024-09-21T14:01:47.512801+0000","last_peered":"2024-09-21T14:01:47.512801+0000","last_clean":"2024-09-21T14:01:47.512801+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:47.512801+0000","last_undegraded":"2024-09-21T14:01:47.512801+0000","last_fullsized":"2024-09-21T14:01:47.512801+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.512730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:28.118655+0000","scrub_duration":0.0028144400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"180'658","reported_seq":5288,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.256347+0000","last_change":"2024-09-21T14:01:43.256499+0000","last_active":"2024-09-21T14:01:43.256347+0000","last_peered":"2024-09-21T14:01:43.256347+0000","last_clean":"2024-09-21T14:01:43.256347+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:43.256347+0000","last_undegraded":"2024-09-21T14:01:43.256347+0000","last_fullsized":"2024-09-21T14:01:43.256347+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'658","last_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_deep_scrub":"180'658","last_deep_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.256328+0000","objects_scrubbed":15,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:15.672081+0000","scrub_duration":0.016808792999999999,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:16.903325+0000","last_change":"2024-09-21T14:02:16.903551+0000","last_active":"2024-09-21T14:02:16.903325+0000","last_peered":"2024-09-21T14:02:16.903325+0000","last_clean":"2024-09-21T14:02:16.903325+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:02:16.903325+0000","last_undegraded":"2024-09-21T14:02:16.903325+0000","last_fullsized":"2024-09-21T14:02:16.903325+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:02:16.903274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:02:16.903274+0000","last_clean_scrub_stamp":"2024-09-21T14:02:16.903274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:52.129585+0000","scrub_duration":0.003394799,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"180'588","reported_seq":20188,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.816927+0000","last_change":"2024-09-21T14:01:48.817199+0000","last_active":"2024-09-21T14:01:48.816927+0000","last_peered":"2024-09-21T14:01:48.816927+0000","last_clean":"2024-09-21T14:01:48.816927+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:48.816927+0000","last_undegraded":"2024-09-21T14:01:48.816927+0000","last_fullsized":"2024-09-21T14:01:48.816927+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'588","last_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_deep_scrub":"180'588","last_deep_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.816853+0000","objects_scrubbed":21,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:40:26.788018+0000","scrub_duration":0.030963671000000002,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"180'2","reported_seq":224,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.761874+0000","last_change":"2024-09-21T14:01:47.761874+0000","last_active":"2024-09-21T14:01:47.761874+0000","last_peered":"2024-09-21T14:01:47.761874+0000","last_clean":"2024-09-21T14:01:47.761874+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:47.761874+0000","last_undegraded":"2024-09-21T14:01:47.761874+0000","last_fullsized":"2024-09-21T14:01:47.761874+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2","last_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_deep_scrub":"180'2","last_deep_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.761603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:41.636595+0000","scrub_duration":0.0057674420000000002,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"180'119","reported_seq":312,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.865787+0000","last_change":"2024-09-21T14:01:58.865787+0000","last_active":"2024-09-21T14:01:58.865787+0000","last_peered":"2024-09-21T14:01:58.865787+0000","last_clean":"2024-09-21T14:01:58.865787+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:58.865787+0000","last_undegraded":"2024-09-21T14:01:58.865787+0000","last_fullsized":"2024-09-21T14:01:58.865787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'119","last_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_deep_scrub":"180'119","last_deep_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.865623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:25.334431+0000","scrub_duration":0.0077650449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"180'513","reported_seq":3594,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:55.976923+0000","last_change":"2024-09-21T14:01:55.977149+0000","last_active":"2024-09-21T14:01:55.976923+0000","last_peered":"2024-09-21T14:01:55.976923+0000","last_clean":"2024-09-21T14:01:55.976923+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:55.976923+0000","last_undegraded":"2024-09-21T14:01:55.976923+0000","last_fullsized":"2024-09-21T14:01:55.976923+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'513","last_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_deep_scrub":"180'513","last_deep_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_clean_scrub_stamp":"2024-09-21T14:01:55.976864+0000","objects_scrubbed":17,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:01.102938+0000","scrub_duration":0.02808488,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"180'440","reported_seq":2915,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.171550+0000","last_change":"2024-09-21T14:01:49.171810+0000","last_active":"2024-09-21T14:01:49.171550+0000","last_peered":"2024-09-21T14:01:49.171550+0000","last_clean":"2024-09-21T14:01:49.171550+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:49.171550+0000","last_undegraded":"2024-09-21T14:01:49.171550+0000","last_fullsized":"2024-09-21T14:01:49.171550+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'440","last_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_deep_scrub":"180'440","last_deep_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.171491+0000","objects_scrubbed":13,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:39.900224+0000","scrub_duration":0.020734200000000001,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"180'808","reported_seq":17027,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.660887+0000","last_change":"2024-09-21T14:01:50.661094+0000","last_active":"2024-09-21T14:01:50.660887+0000","last_peered":"2024-09-21T14:01:50.660887+0000","last_clean":"2024-09-21T14:01:50.660887+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:50.660887+0000","last_undegraded":"2024-09-21T14:01:50.660887+0000","last_fullsized":"2024-09-21T14:01:50.660887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'808","last_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_deep_scrub":"180'808","last_deep_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.660835+0000","objects_scrubbed":28,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:06.622117+0000","scrub_duration":0.050819949000000003,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"180'584","reported_seq":4012,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.820758+0000","last_change":"2024-09-21T14:01:49.821009+0000","last_active":"2024-09-21T14:01:49.820758+0000","last_peered":"2024-09-21T14:01:49.820758+0000","last_clean":"2024-09-21T14:01:49.820758+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:49.820758+0000","last_undegraded":"2024-09-21T14:01:49.820758+0000","last_fullsized":"2024-09-21T14:01:49.820758+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'584","last_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_deep_scrub":"180'584","last_deep_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.820705+0000","objects_scrubbed":16,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:29.221232+0000","scrub_duration":0.028617111000000001,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"180'575","reported_seq":4241,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.801657+0000","last_change":"2024-09-21T14:01:56.801780+0000","last_active":"2024-09-21T14:01:56.801657+0000","last_peered":"2024-09-21T14:01:56.801657+0000","last_clean":"2024-09-21T14:01:56.801657+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:56.801657+0000","last_undegraded":"2024-09-21T14:01:56.801657+0000","last_fullsized":"2024-09-21T14:01:56.801657+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'575","last_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_deep_scrub":"180'575","last_deep_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.801631+0000","objects_scrubbed":19,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:56:00.843359+0000","scrub_duration":0.026441732999999999,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"158'440","reported_seq":4994,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:45.274920+0000","last_change":"2024-09-21T14:01:28.524304+0000","last_active":"2024-09-21T14:01:45.274920+0000","last_peered":"2024-09-21T14:01:45.274920+0000","last_clean":"2024-09-21T14:01:45.274920+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:01:45.274920+0000","last_undegraded":"2024-09-21T14:01:45.274920+0000","last_fullsized":"2024-09-21T14:01:45.274920+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T13:58:20.631560+0000","last_clean_scrub_stamp":"2024-09-21T13:58:20.631560+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"180'583","reported_seq":8010,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:01.913882+0000","last_change":"2024-09-21T14:02:01.913882+0000","last_active":"2024-09-21T14:02:01.913882+0000","last_peered":"2024-09-21T14:02:01.913882+0000","last_clean":"2024-09-21T14:02:01.913882+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:02:01.913882+0000","last_undegraded":"2024-09-21T14:02:01.913882+0000","last_fullsized":"2024-09-21T14:02:01.913882+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'583","last_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_deep_scrub":"180'583","last_deep_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_clean_scrub_stamp":"2024-09-21T14:02:01.913534+0000","objects_scrubbed":15,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:16:30.074136+0000","scrub_duration":0.027399421,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"180'684","reported_seq":5635,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:08.867219+0000","last_change":"2024-09-21T14:02:08.867219+0000","last_active":"2024-09-21T14:02:08.867219+0000","last_peered":"2024-09-21T14:02:08.867219+0000","last_clean":"2024-09-21T14:02:08.867219+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:02:08.867219+0000","last_undegraded":"2024-09-21T14:02:08.867219+0000","last_fullsized":"2024-09-21T14:02:08.867219+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'684","last_scrub_stamp":"2024-09-21T14:02:08.866937+0000","last_deep_scrub":"180'684","last_deep_scrub_stamp":"2024-09-21T14:02:08.866937+0000","last_clean_scrub_stamp":"2024-09-21T14:02:08.866937+0000","objects_scrubbed":12,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:22:54.444965+0000","scrub_duration":0.023418060000000001,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"180'672","reported_seq":4887,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.643167+0000","last_change":"2024-09-21T14:01:49.643400+0000","last_active":"2024-09-21T14:01:49.643167+0000","last_peered":"2024-09-21T14:01:49.643167+0000","last_clean":"2024-09-21T14:01:49.643167+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:49.643167+0000","last_undegraded":"2024-09-21T14:01:49.643167+0000","last_fullsized":"2024-09-21T14:01:49.643167+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'672","last_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_deep_scrub":"180'672","last_deep_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.643110+0000","objects_scrubbed":18,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:36:49.695799+0000","scrub_duration":0.028678182999999999,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"180'343","reported_seq":4106,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:10.943795+0000","last_change":"2024-09-21T14:02:10.943795+0000","last_active":"2024-09-21T14:02:10.943795+0000","last_peered":"2024-09-21T14:02:10.943795+0000","last_clean":"2024-09-21T14:02:10.943795+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:02:10.943795+0000","last_undegraded":"2024-09-21T14:02:10.943795+0000","last_fullsized":"2024-09-21T14:02:10.943795+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'343","last_scrub_stamp":"2024-09-21T14:02:10.943444+0000","last_deep_scrub":"180'343","last_deep_scrub_stamp":"2024-09-21T14:02:10.943444+0000","last_clean_scrub_stamp":"2024-09-21T14:02:10.943444+0000","objects_scrubbed":19,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.606959+0000","scrub_duration":0.030481133000000001,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"180'1019","reported_seq":5021,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.213029+0000","last_change":"2024-09-21T14:01:48.213291+0000","last_active":"2024-09-21T14:01:48.213029+0000","last_peered":"2024-09-21T14:01:48.213029+0000","last_clean":"2024-09-21T14:01:48.213029+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:48.213029+0000","last_undegraded":"2024-09-21T14:01:48.213029+0000","last_fullsized":"2024-09-21T14:01:48.213029+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'1019","last_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_deep_scrub":"180'1019","last_deep_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.212975+0000","objects_scrubbed":16,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:55:31.897590+0000","scrub_duration":0.028793046999999999,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"180'429","reported_seq":1704,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:00.902319+0000","last_change":"2024-09-21T14:02:00.902567+0000","last_active":"2024-09-21T14:02:00.902319+0000","last_peered":"2024-09-21T14:02:00.902319+0000","last_clean":"2024-09-21T14:02:00.902319+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:02:00.902319+0000","last_undegraded":"2024-09-21T14:02:00.902319+0000","last_fullsized":"2024-09-21T14:02:00.902319+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'429","last_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_deep_scrub":"180'429","last_deep_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_clean_scrub_stamp":"2024-09-21T14:02:00.902263+0000","objects_scrubbed":13,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:34.904723+0000","scrub_duration":0.022654962000000001,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21953,"ondisk_log_size":21953,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925856,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84199999999999997},"min":{"1min":0.50700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.256,"5min":1.468,"15min":1.468},"last":1.149},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.48199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1120000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.78400000000000003,"15min":0.76700000000000002},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1140000000000001,"5min":1.488,"15min":1.488},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.61799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.163,"5min":1.23,"15min":1.23},"last":1.1930000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.65000000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2010000000000001,"5min":1.514,"15min":1.514},"last":0.94699999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3160000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.998,"15min":0.98499999999999999},"min":{"1min":0.72099999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.431,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.109}]},{"osd":4,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.57599999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.61199999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.89300000000000002}]},{"osd":5,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97599999999999998,"15min":0.97499999999999998},"min":{"1min":0.67400000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.224,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.006},{"interface":"front","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95399999999999996},"min":{"1min":0.67800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.3440000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.98099999999999998}]},{"osd":6,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.98099999999999998,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":1.05},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0369999999999999,"15min":1.0249999999999999},"min":{"1min":0.65500000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4079999999999999,"5min":1.508,"15min":1.508},"last":1.032}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77520,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294320,"statfs":{"total":96636764160,"available":96557383680,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77199815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.167,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.091,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72999999999999998,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1279999999999999,"5min":1.268,"15min":1.268},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.90600000000000003,"15min":0.98499999999999999},"min":{"1min":0.65200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1679999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.96499999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86399999999999999,"15min":0.85099999999999998},"min":{"1min":0.72999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.94199999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.877,"15min":0.89900000000000002},"min":{"1min":0.61599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.133,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.337,"5min":1.367,"15min":1.367},"last":0.91100000000000003}]},{"osd":4,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.628,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2090000000000001,"5min":1.353,"15min":1.353},"last":1.071},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.94699999999999995,"15min":0.995},"min":{"1min":0.91800000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2450000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.1060000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.3959999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.92400000000000004,"15min":0.94999999999999996},"min":{"1min":0.66800000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.369,"5min":1.403,"15min":1.403},"last":1.208}]},{"osd":7,"last update":"Sat Sep 21 14:02:05 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95399999999999996,"15min":0.94199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.282,"5min":1.484,"15min":1.484},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.0940000000000001,"15min":1.107},"min":{"1min":0.56200000000000006,"5min":0.434,"15min":0.434},"max":{"1min":1.3100000000000001,"5min":4.976,"15min":4.976},"last":1.0369999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59476,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312364,"statfs":{"total":96636764160,"available":96575860736,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1719999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.54100000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.78100000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.65700000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0800000000000001,"5min":1.351,"15min":1.351},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.505,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.56000000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.94299999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.69899999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.101},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.036,"15min":1.1719999999999999},"min":{"1min":0.74399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.218,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.1259999999999999}]},{"osd":4,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.878,"15min":0.88},"min":{"1min":0.64500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.421,"15min":1.421},"last":1.145}]},{"osd":6,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.70699999999999996,"5min":0.312,"15min":0.312},"max":{"1min":1.1859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.68500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.286,"5min":1.696,"15min":1.696},"last":0.99199999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.96099999999999997,"15min":0.94199999999999995},"min":{"1min":0.85199999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.522,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.099,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.80700000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6439999999999999,"5min":2.222,"15min":2.222},"last":1.1679999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.52500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2470000000000001,"5min":1.274,"15min":1.274},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.84999999999999998,"15min":0.89500000000000002},"min":{"1min":0.65900000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.2050000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.53,"15min":2.306},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2909999999999999,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2070000000000001,"5min":1.528,"15min":1.528},"last":1.03}]},{"osd":2,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.871,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2989999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.85899999999999999,"15min":0.872},"min":{"1min":0.67400000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.157,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.054,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2270000000000001,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.74,"15min":2.6890000000000001},"min":{"1min":0.57999999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":41.155000000000001,"15min":41.155000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.85199999999999998,"15min":0.88400000000000001},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.363,"5min":1.476,"15min":1.476},"last":1.163},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.998,"15min":1.006},"min":{"1min":0.51800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.958,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":1.335}]},{"osd":6,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":1.53,"15min":2.258},"min":{"1min":0.57299999999999995,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.014,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2430000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.0720000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.77700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.3280000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.125},{"interface":"front","average":{"1min":1.202,"5min":0.97899999999999998,"15min":0.94199999999999995},"min":{"1min":0.89200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6259999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.266}]}]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51280,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320560,"statfs":{"total":96636764160,"available":96584253440,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.51100000000000001,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.88900000000000001,"5min":1.296,"15min":1.296},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.90300000000000002,"5min":1.873,"15min":1.873},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84699999999999998,"15min":0.77700000000000002},"min":{"1min":0.378,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.038,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.58099999999999996,"15min":0.53700000000000003},"min":{"1min":0.45600000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0820000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95399999999999996,"15min":0.88500000000000001},"min":{"1min":0.47299999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.196,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.94899999999999995}]},{"osd":4,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":0.90800000000000003},"min":{"1min":0.60899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3009999999999999,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90400000000000003,"15min":0.92800000000000005},"min":{"1min":0.77100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5209999999999999,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":0.91500000000000004}]},{"osd":5,"last update":"Sat Sep 21 14:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89900000000000002,"15min":0.98099999999999998},"min":{"1min":0.62,"5min":0.378,"15min":0.378},"max":{"1min":1.3360000000000001,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.86399999999999999,"15min":0.90000000000000002},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.403,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.151,"15min":1.087},"min":{"1min":0.75,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7250000000000001,"5min":22.157,"15min":22.157},"last":1.046},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.88100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.367,"5min":2.641,"15min":2.641},"last":1.155}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.91900000000000004,"15min":0.90300000000000002},"min":{"1min":0.65700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.077},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.90700000000000003,"15min":0.88100000000000001},"min":{"1min":0.70599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.109}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.35399999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.77400000000000002,"5min":3.399,"15min":3.399},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.28899999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.93300000000000005,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.627}]},{"osd":1,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.996,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.746},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1359999999999999,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.77900000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.0800000000000001,"15min":1.3740000000000001},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1739999999999999,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.1100000000000001,"15min":1.4319999999999999},"min":{"1min":0.40500000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.0629999999999999,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.63500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.2450000000000001,"5min":1.609,"15min":1.609},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0620000000000001,"15min":1.224},"min":{"1min":0.62,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4259999999999999,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.137}]},{"osd":5,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.876,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1240000000000001,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":1.054},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.89900000000000002,"15min":0.92300000000000004},"min":{"1min":0.73699999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.169,"5min":1.534,"15min":1.534},"last":1.2050000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94599999999999995,"15min":0.96799999999999997},"min":{"1min":0.78300000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5489999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.77800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.204,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.1719999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6339999999999999,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0489999999999999,"15min":1.056},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2829999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.23}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.89700000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.495,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.99199999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.76000000000000001}]},{"osd":2,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.67500000000000004,"15min":0.64200000000000002},"min":{"1min":0.53100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":1.379,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.714,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.95399999999999996,"15min":1.288},"min":{"1min":0.46300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.044,"5min":13.083,"15min":13.083},"last":0.70599999999999996}]},{"osd":4,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.85599999999999998,"15min":0.82099999999999995},"min":{"1min":0.74399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.879,"15min":0.85299999999999998},"min":{"1min":0.71999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.292,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.014}]},{"osd":5,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.80400000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.732,"15min":1.732},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.048,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.77400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.88}]},{"osd":6,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.69599999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.96599999999999997,"15min":1.004},"min":{"1min":0.84399999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.7509999999999999,"5min":2.48,"15min":2.48},"last":1.0580000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":0.91900000000000004,"15min":0.88700000000000001},"min":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.036,"5min":0.88600000000000001,"15min":0.86099999999999999},"min":{"1min":0.80300000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.91400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":1.01},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65600000000000003,"15min":0.69399999999999995},"min":{"1min":0.35899999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.0600000000000001,"5min":1.206,"15min":1.206},"last":0.58299999999999996}]},{"osd":2,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.70499999999999996,"15min":0.77900000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":4.2869999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.79200000000000004,"15min":0.97399999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.143,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.94099999999999995}]},{"osd":3,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":1.0569999999999999},"min":{"1min":0.53800000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.0620000000000001,"5min":11.84,"15min":11.84},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.73499999999999999,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.749}]},{"osd":4,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.875,"15min":0.90700000000000003},"min":{"1min":0.58999999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2410000000000001,"5min":1.647,"15min":1.647},"last":1.222},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.85199999999999998,"15min":0.88200000000000001},"min":{"1min":0.67900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.198,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.91200000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":0.89100000000000001,"15min":0.873},"min":{"1min":0.66400000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.26,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":1.179}]},{"osd":6,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.026,"15min":1.0900000000000001},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.629,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.147}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0429999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:02:26.270 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-21T13:58:20.631560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=13, tm_min=58, tm_sec=20, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=14, tm_min=1, tm_sec=40, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T14:02:26.270 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T14:02:46.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T14:02:46.584 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T14:02:46.584 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-21T14:02:46.600 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-21T14:02:45.203957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":592,"num_object_clones":0,"num_object_copies":1184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":592,"num_whiteouts":584,"num_read":285631,"num_read_kb":932003,"num_write":24765,"num_write_kb":499605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6852,"num_bytes_recovered":466885885,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22095,"ondisk_log_size":22095,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":450008,"kb_used_data":18136,"kb_used_omap":25,"kb_used_meta":431782,"kb_avail":754524712,"statfs":{"total":773094113280,"available":772633305088,"internally_reserved":0,"allocated":18571264,"data_stored":9524500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25613,"internal_metadata":442145779},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003488"},"pg_stats":[{"pgid":"3.1f","version":"180'436","reported_seq":3135,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.203994+0000","last_change":"2024-09-21T14:01:59.203994+0000","last_active":"2024-09-21T14:01:59.203994+0000","last_peered":"2024-09-21T14:01:59.203994+0000","last_clean":"2024-09-21T14:01:59.203994+0000","last_became_active":"2024-09-21T14:00:21.315322+0000","last_became_peered":"2024-09-21T14:00:21.315322+0000","last_unstale":"2024-09-21T14:01:59.203994+0000","last_undegraded":"2024-09-21T14:01:59.203994+0000","last_fullsized":"2024-09-21T14:01:59.203994+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:59.203596+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.203596+0000","objects_scrubbed":15,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:35:56.186557+0000","scrub_duration":0.025858689000000001,"objects_trimmed":0,"snaptrim_duration":0.005969767,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":2910,"num_read_kb":9006,"num_write":449,"num_write_kb":8549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11438660,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"180'1003","reported_seq":18948,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:09.759403+0000","last_change":"2024-09-21T14:02:09.759403+0000","last_active":"2024-09-21T14:02:09.759403+0000","last_peered":"2024-09-21T14:02:09.759403+0000","last_clean":"2024-09-21T14:02:09.759403+0000","last_became_active":"2024-09-21T14:00:39.439176+0000","last_became_peered":"2024-09-21T14:00:39.439176+0000","last_unstale":"2024-09-21T14:02:09.759403+0000","last_undegraded":"2024-09-21T14:02:09.759403+0000","last_fullsized":"2024-09-21T14:02:09.759403+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'1003","last_scrub_stamp":"2024-09-21T14:02:09.759072+0000","last_deep_scrub":"180'1003","last_deep_scrub_stamp":"2024-09-21T14:02:09.759072+0000","last_clean_scrub_stamp":"2024-09-21T14:02:09.759072+0000","objects_scrubbed":14,"log_size":1003,"log_dups_size":0,"ondisk_log_size":1003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:33:09.994891+0000","scrub_duration":0.029909120000000001,"objects_trimmed":0,"snaptrim_duration":0.0037800199999999998,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":22002,"num_read_kb":57615,"num_write":1189,"num_write_kb":26394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":138,"num_bytes_recovered":15596306,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"180'885","reported_seq":7459,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:06.743850+0000","last_change":"2024-09-21T14:02:06.744193+0000","last_active":"2024-09-21T14:02:06.743850+0000","last_peered":"2024-09-21T14:02:06.743850+0000","last_clean":"2024-09-21T14:02:06.743850+0000","last_became_active":"2024-09-21T13:58:21.669660+0000","last_became_peered":"2024-09-21T13:58:21.669660+0000","last_unstale":"2024-09-21T14:02:06.743850+0000","last_undegraded":"2024-09-21T14:02:06.743850+0000","last_fullsized":"2024-09-21T14:02:06.743850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'885","last_scrub_stamp":"2024-09-21T14:02:06.743799+0000","last_deep_scrub":"180'885","last_deep_scrub_stamp":"2024-09-21T14:02:06.743799+0000","last_clean_scrub_stamp":"2024-09-21T14:02:06.743799+0000","objects_scrubbed":19,"log_size":885,"log_dups_size":0,"ondisk_log_size":885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:23:58.951293+0000","scrub_duration":0.040052422999999997,"objects_trimmed":0,"snaptrim_duration":0.0021592529999999999,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":10365,"num_read_kb":39928,"num_write":951,"num_write_kb":17706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"180'612","reported_seq":4550,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:07.724038+0000","last_change":"2024-09-21T14:02:07.724302+0000","last_active":"2024-09-21T14:02:07.724038+0000","last_peered":"2024-09-21T14:02:07.724038+0000","last_clean":"2024-09-21T14:02:07.724038+0000","last_became_active":"2024-09-21T13:58:21.669872+0000","last_became_peered":"2024-09-21T13:58:21.669872+0000","last_unstale":"2024-09-21T14:02:07.724038+0000","last_undegraded":"2024-09-21T14:02:07.724038+0000","last_fullsized":"2024-09-21T14:02:07.724038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'612","last_scrub_stamp":"2024-09-21T14:02:07.723979+0000","last_deep_scrub":"180'612","last_deep_scrub_stamp":"2024-09-21T14:02:07.723979+0000","last_clean_scrub_stamp":"2024-09-21T14:02:07.723979+0000","objects_scrubbed":21,"log_size":612,"log_dups_size":0,"ondisk_log_size":612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:16.930424+0000","scrub_duration":0.037140123999999997,"objects_trimmed":0,"snaptrim_duration":0.001794208,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":20,"num_read":6018,"num_read_kb":20294,"num_write":720,"num_write_kb":15045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"180'447","reported_seq":1981,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:57.262502+0000","last_change":"2024-09-21T14:01:57.262840+0000","last_active":"2024-09-21T14:01:57.262502+0000","last_peered":"2024-09-21T14:01:57.262502+0000","last_clean":"2024-09-21T14:01:57.262502+0000","last_became_active":"2024-09-21T14:00:23.177042+0000","last_became_peered":"2024-09-21T14:00:23.177042+0000","last_unstale":"2024-09-21T14:01:57.262502+0000","last_undegraded":"2024-09-21T14:01:57.262502+0000","last_fullsized":"2024-09-21T14:01:57.262502+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'447","last_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_deep_scrub":"180'447","last_deep_scrub_stamp":"2024-09-21T14:01:57.262445+0000","last_clean_scrub_stamp":"2024-09-21T14:01:57.262445+0000","objects_scrubbed":21,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:02:38.983514+0000","scrub_duration":0.032095513999999999,"objects_trimmed":0,"snaptrim_duration":0.0075889290000000003,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":1195,"num_read_kb":12017,"num_write":427,"num_write_kb":13384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":301,"num_bytes_recovered":14717371,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"180'760","reported_seq":19608,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.177216+0000","last_change":"2024-09-21T14:01:50.177442+0000","last_active":"2024-09-21T14:01:50.177216+0000","last_peered":"2024-09-21T14:01:50.177216+0000","last_clean":"2024-09-21T14:01:50.177216+0000","last_became_active":"2024-09-21T13:59:39.380828+0000","last_became_peered":"2024-09-21T13:59:39.380828+0000","last_unstale":"2024-09-21T14:01:50.177216+0000","last_undegraded":"2024-09-21T14:01:50.177216+0000","last_fullsized":"2024-09-21T14:01:50.177216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'760","last_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_deep_scrub":"180'760","last_deep_scrub_stamp":"2024-09-21T14:01:50.177150+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.177150+0000","objects_scrubbed":18,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:41:05.314784+0000","scrub_duration":0.030104995999999998,"objects_trimmed":0,"snaptrim_duration":0.002371251,"stat_sum":{"num_bytes":19,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":17,"num_read":19523,"num_read_kb":29144,"num_write":847,"num_write_kb":13075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":219,"num_bytes_recovered":19532147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"180'453","reported_seq":5989,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.716499+0000","last_change":"2024-09-21T14:01:50.716820+0000","last_active":"2024-09-21T14:01:50.716499+0000","last_peered":"2024-09-21T14:01:50.716499+0000","last_clean":"2024-09-21T14:01:50.716499+0000","last_became_active":"2024-09-21T14:01:19.201994+0000","last_became_peered":"2024-09-21T14:01:19.201994+0000","last_unstale":"2024-09-21T14:01:50.716499+0000","last_undegraded":"2024-09-21T14:01:50.716499+0000","last_fullsized":"2024-09-21T14:01:50.716499+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'453","last_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_deep_scrub":"180'453","last_deep_scrub_stamp":"2024-09-21T14:01:50.716441+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.716441+0000","objects_scrubbed":20,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:19:51.139810+0000","scrub_duration":0.030627534000000001,"objects_trimmed":0,"snaptrim_duration":0.0014766880000000001,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":20,"num_read":4804,"num_read_kb":32865,"num_write":388,"num_write_kb":13919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":4709689,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"180'719","reported_seq":35978,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:52.888232+0000","last_change":"2024-09-21T14:01:52.888563+0000","last_active":"2024-09-21T14:01:52.888232+0000","last_peered":"2024-09-21T14:01:52.888232+0000","last_clean":"2024-09-21T14:01:52.888232+0000","last_became_active":"2024-09-21T14:01:17.198555+0000","last_became_peered":"2024-09-21T14:01:17.198555+0000","last_unstale":"2024-09-21T14:01:52.888232+0000","last_undegraded":"2024-09-21T14:01:52.888232+0000","last_fullsized":"2024-09-21T14:01:52.888232+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'719","last_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_deep_scrub":"180'719","last_deep_scrub_stamp":"2024-09-21T14:01:52.888176+0000","last_clean_scrub_stamp":"2024-09-21T14:01:52.888176+0000","objects_scrubbed":18,"log_size":719,"log_dups_size":0,"ondisk_log_size":719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:56:08.359640+0000","scrub_duration":0.034063126999999999,"objects_trimmed":0,"snaptrim_duration":0.0081495430000000004,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":36341,"num_read_kb":77487,"num_write":721,"num_write_kb":11070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":422,"num_bytes_recovered":19312852,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"180'432","reported_seq":2208,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.250261+0000","last_change":"2024-09-21T14:01:58.250447+0000","last_active":"2024-09-21T14:01:58.250261+0000","last_peered":"2024-09-21T14:01:58.250261+0000","last_clean":"2024-09-21T14:01:58.250261+0000","last_became_active":"2024-09-21T14:00:21.315515+0000","last_became_peered":"2024-09-21T14:00:21.315515+0000","last_unstale":"2024-09-21T14:01:58.250261+0000","last_undegraded":"2024-09-21T14:01:58.250261+0000","last_fullsized":"2024-09-21T14:01:58.250261+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'432","last_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_deep_scrub":"180'432","last_deep_scrub_stamp":"2024-09-21T14:01:58.250229+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.250229+0000","objects_scrubbed":17,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:50:13.549945+0000","scrub_duration":0.024698100000000001,"objects_trimmed":0,"snaptrim_duration":0.007015884,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":1068,"num_read_kb":37860,"num_write":362,"num_write_kb":15656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":228,"num_bytes_recovered":25291412,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"180'596","reported_seq":3154,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:04.803191+0000","last_change":"2024-09-21T14:02:04.803435+0000","last_active":"2024-09-21T14:02:04.803191+0000","last_peered":"2024-09-21T14:02:04.803191+0000","last_clean":"2024-09-21T14:02:04.803191+0000","last_became_active":"2024-09-21T14:00:05.197742+0000","last_became_peered":"2024-09-21T14:00:05.197742+0000","last_unstale":"2024-09-21T14:02:04.803191+0000","last_undegraded":"2024-09-21T14:02:04.803191+0000","last_fullsized":"2024-09-21T14:02:04.803191+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'596","last_scrub_stamp":"2024-09-21T14:02:04.803139+0000","last_deep_scrub":"180'596","last_deep_scrub_stamp":"2024-09-21T14:02:04.803139+0000","last_clean_scrub_stamp":"2024-09-21T14:02:04.803139+0000","objects_scrubbed":24,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:27.837444+0000","scrub_duration":0.042309135999999997,"objects_trimmed":0,"snaptrim_duration":0.0023394520000000001,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":3670,"num_read_kb":24918,"num_write":664,"num_write_kb":16440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":12956773,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"180'553","reported_seq":3277,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:22.970573+0000","last_change":"2024-09-21T14:02:22.970573+0000","last_active":"2024-09-21T14:02:22.970573+0000","last_peered":"2024-09-21T14:02:22.970573+0000","last_clean":"2024-09-21T14:02:22.970573+0000","last_became_active":"2024-09-21T14:01:28.514577+0000","last_became_peered":"2024-09-21T14:01:28.514577+0000","last_unstale":"2024-09-21T14:02:22.970573+0000","last_undegraded":"2024-09-21T14:02:22.970573+0000","last_fullsized":"2024-09-21T14:02:22.970573+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'553","last_scrub_stamp":"2024-09-21T14:02:22.970300+0000","last_deep_scrub":"180'553","last_deep_scrub_stamp":"2024-09-21T14:02:22.970300+0000","last_clean_scrub_stamp":"2024-09-21T14:02:22.970300+0000","objects_scrubbed":25,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:32:12.195252+0000","scrub_duration":0.039876474000000002,"objects_trimmed":2,"snaptrim_duration":0.011595072999999999,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":2914,"num_read_kb":22314,"num_write":436,"num_write_kb":15019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":267,"num_bytes_recovered":17743303,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"180'436","reported_seq":2300,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:51.226164+0000","last_change":"2024-09-21T14:01:51.226462+0000","last_active":"2024-09-21T14:01:51.226164+0000","last_peered":"2024-09-21T14:01:51.226164+0000","last_clean":"2024-09-21T14:01:51.226164+0000","last_became_active":"2024-09-21T14:00:03.174191+0000","last_became_peered":"2024-09-21T14:00:03.174191+0000","last_unstale":"2024-09-21T14:01:51.226164+0000","last_undegraded":"2024-09-21T14:01:51.226164+0000","last_fullsized":"2024-09-21T14:01:51.226164+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'436","last_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_deep_scrub":"180'436","last_deep_scrub_stamp":"2024-09-21T14:01:51.226108+0000","last_clean_scrub_stamp":"2024-09-21T14:01:51.226108+0000","objects_scrubbed":22,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:49:44.247530+0000","scrub_duration":0.03787227,"objects_trimmed":0,"snaptrim_duration":0.0028366070000000001,"stat_sum":{"num_bytes":0,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":22,"num_read":1644,"num_read_kb":13826,"num_write":363,"num_write_kb":9510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":6764223,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":202,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.536540+0000","last_change":"2024-09-21T14:01:46.536540+0000","last_active":"2024-09-21T14:01:46.536540+0000","last_peered":"2024-09-21T14:01:46.536540+0000","last_clean":"2024-09-21T14:01:46.536540+0000","last_became_active":"2024-09-21T14:00:00.530597+0000","last_became_peered":"2024-09-21T14:00:00.530597+0000","last_unstale":"2024-09-21T14:01:46.536540+0000","last_undegraded":"2024-09-21T14:01:46.536540+0000","last_fullsized":"2024-09-21T14:01:46.536540+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:46.536215+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.536215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:17:03.834566+0000","scrub_duration":0.003274473,"objects_trimmed":0,"snaptrim_duration":0.00069002500000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"180'502","reported_seq":2806,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.258594+0000","last_change":"2024-09-21T14:01:49.258594+0000","last_active":"2024-09-21T14:01:49.258594+0000","last_peered":"2024-09-21T14:01:49.258594+0000","last_clean":"2024-09-21T14:01:49.258594+0000","last_became_active":"2024-09-21T14:01:18.202733+0000","last_became_peered":"2024-09-21T14:01:18.202733+0000","last_unstale":"2024-09-21T14:01:49.258594+0000","last_undegraded":"2024-09-21T14:01:49.258594+0000","last_fullsized":"2024-09-21T14:01:49.258594+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'502","last_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_deep_scrub":"180'502","last_deep_scrub_stamp":"2024-09-21T14:01:49.258223+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.258223+0000","objects_scrubbed":14,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:02:36.962931+0000","scrub_duration":0.025900291999999998,"objects_trimmed":0,"snaptrim_duration":0.0031190219999999999,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":14,"num_read":2164,"num_read_kb":10095,"num_write":521,"num_write_kb":11224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":266,"num_bytes_recovered":14115687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.696315+0000","last_change":"2024-09-21T14:01:48.696555+0000","last_active":"2024-09-21T14:01:48.696315+0000","last_peered":"2024-09-21T14:01:48.696315+0000","last_clean":"2024-09-21T14:01:48.696315+0000","last_became_active":"2024-09-21T14:01:15.398136+0000","last_became_peered":"2024-09-21T14:01:15.398136+0000","last_unstale":"2024-09-21T14:01:48.696315+0000","last_undegraded":"2024-09-21T14:01:48.696315+0000","last_fullsized":"2024-09-21T14:01:48.696315+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:48.696263+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.696263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:38:43.430803+0000","scrub_duration":0.0032478950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"180'720","reported_seq":5280,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.998187+0000","last_change":"2024-09-21T14:01:56.998405+0000","last_active":"2024-09-21T14:01:56.998187+0000","last_peered":"2024-09-21T14:01:56.998187+0000","last_clean":"2024-09-21T14:01:56.998187+0000","last_became_active":"2024-09-21T14:01:18.205128+0000","last_became_peered":"2024-09-21T14:01:18.205128+0000","last_unstale":"2024-09-21T14:01:56.998187+0000","last_undegraded":"2024-09-21T14:01:56.998187+0000","last_fullsized":"2024-09-21T14:01:56.998187+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'720","last_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_deep_scrub":"180'720","last_deep_scrub_stamp":"2024-09-21T14:01:56.998135+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.998135+0000","objects_scrubbed":26,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:27:56.829390+0000","scrub_duration":0.043121674999999998,"objects_trimmed":0,"snaptrim_duration":0.0041386879999999997,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":6013,"num_read_kb":23983,"num_write":750,"num_write_kb":15029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":375,"num_bytes_recovered":10816194,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:59.844908+0000","last_change":"2024-09-21T14:01:59.844908+0000","last_active":"2024-09-21T14:01:59.844908+0000","last_peered":"2024-09-21T14:01:59.844908+0000","last_clean":"2024-09-21T14:01:59.844908+0000","last_became_active":"2024-09-21T14:00:18.283372+0000","last_became_peered":"2024-09-21T14:00:18.283372+0000","last_unstale":"2024-09-21T14:01:59.844908+0000","last_undegraded":"2024-09-21T14:01:59.844908+0000","last_fullsized":"2024-09-21T14:01:59.844908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:59.844693+0000","last_clean_scrub_stamp":"2024-09-21T14:01:59.844693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:27:26.069899+0000","scrub_duration":0.0031788620000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"180'988","reported_seq":7387,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.731273+0000","last_change":"2024-09-21T14:01:47.731535+0000","last_active":"2024-09-21T14:01:47.731273+0000","last_peered":"2024-09-21T14:01:47.731273+0000","last_clean":"2024-09-21T14:01:47.731273+0000","last_became_active":"2024-09-21T14:01:20.200838+0000","last_became_peered":"2024-09-21T14:01:20.200838+0000","last_unstale":"2024-09-21T14:01:47.731273+0000","last_undegraded":"2024-09-21T14:01:47.731273+0000","last_fullsized":"2024-09-21T14:01:47.731273+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'988","last_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_deep_scrub":"180'988","last_deep_scrub_stamp":"2024-09-21T14:01:47.731216+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.731216+0000","objects_scrubbed":16,"log_size":988,"log_dups_size":0,"ondisk_log_size":988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T00:23:53.053542+0000","scrub_duration":0.029781637999999999,"objects_trimmed":0,"snaptrim_duration":0.004907036,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8305,"num_read_kb":19967,"num_write":1182,"num_write_kb":7182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":531,"num_bytes_recovered":10366096,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.668600+0000","last_change":"2024-09-21T14:01:43.668685+0000","last_active":"2024-09-21T14:01:43.668600+0000","last_peered":"2024-09-21T14:01:43.668600+0000","last_clean":"2024-09-21T14:01:43.668600+0000","last_became_active":"2024-09-21T14:01:15.398903+0000","last_became_peered":"2024-09-21T14:01:15.398903+0000","last_unstale":"2024-09-21T14:01:43.668600+0000","last_undegraded":"2024-09-21T14:01:43.668600+0000","last_fullsized":"2024-09-21T14:01:43.668600+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:43.668563+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.668563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:51:25.894901+0000","scrub_duration":0.0014558869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"180'817","reported_seq":20743,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:53.805913+0000","last_change":"2024-09-21T14:01:53.805913+0000","last_active":"2024-09-21T14:01:53.805913+0000","last_peered":"2024-09-21T14:01:53.805913+0000","last_clean":"2024-09-21T14:01:53.805913+0000","last_became_active":"2024-09-21T14:01:17.199592+0000","last_became_peered":"2024-09-21T14:01:17.199592+0000","last_unstale":"2024-09-21T14:01:53.805913+0000","last_undegraded":"2024-09-21T14:01:53.805913+0000","last_fullsized":"2024-09-21T14:01:53.805913+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'817","last_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_deep_scrub":"180'817","last_deep_scrub_stamp":"2024-09-21T14:01:53.805581+0000","last_clean_scrub_stamp":"2024-09-21T14:01:53.805581+0000","objects_scrubbed":17,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:37:59.565397+0000","scrub_duration":0.036104471999999999,"objects_trimmed":0,"snaptrim_duration":0.0026693849999999998,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":22275,"num_read_kb":62356,"num_write":834,"num_write_kb":24189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":14873013,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"180'649","reported_seq":1991,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.152843+0000","last_change":"2024-09-21T14:01:46.152843+0000","last_active":"2024-09-21T14:01:46.152843+0000","last_peered":"2024-09-21T14:01:46.152843+0000","last_clean":"2024-09-21T14:01:46.152843+0000","last_became_active":"2024-09-21T14:00:24.179198+0000","last_became_peered":"2024-09-21T14:00:24.179198+0000","last_unstale":"2024-09-21T14:01:46.152843+0000","last_undegraded":"2024-09-21T14:01:46.152843+0000","last_fullsized":"2024-09-21T14:01:46.152843+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'649","last_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_deep_scrub":"180'649","last_deep_scrub_stamp":"2024-09-21T14:01:46.152517+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.152517+0000","objects_scrubbed":20,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:24:04.271846+0000","scrub_duration":0.040001257999999998,"objects_trimmed":0,"snaptrim_duration":0.0029944390000000002,"stat_sum":{"num_bytes":0,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":19,"num_read":1473,"num_read_kb":10536,"num_write":672,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":16322062,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"180'3","reported_seq":215,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.762340+0000","last_change":"2024-09-21T14:01:49.762340+0000","last_active":"2024-09-21T14:01:49.762340+0000","last_peered":"2024-09-21T14:01:49.762340+0000","last_clean":"2024-09-21T14:01:49.762340+0000","last_became_active":"2024-09-21T13:59:36.341106+0000","last_became_peered":"2024-09-21T13:59:36.341106+0000","last_unstale":"2024-09-21T14:01:49.762340+0000","last_undegraded":"2024-09-21T14:01:49.762340+0000","last_fullsized":"2024-09-21T14:01:49.762340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'3","last_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_deep_scrub":"180'3","last_deep_scrub_stamp":"2024-09-21T14:01:49.762070+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.762070+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:40:22.234496+0000","scrub_duration":0.0059972330000000003,"objects_trimmed":0,"snaptrim_duration":0.0018074359999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"180'2609","reported_seq":22273,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:46.723228+0000","last_change":"2024-09-21T14:01:46.723613+0000","last_active":"2024-09-21T14:01:46.723228+0000","last_peered":"2024-09-21T14:01:46.723228+0000","last_clean":"2024-09-21T14:01:46.723228+0000","last_became_active":"2024-09-21T14:01:20.200368+0000","last_became_peered":"2024-09-21T14:01:20.200368+0000","last_unstale":"2024-09-21T14:01:46.723228+0000","last_undegraded":"2024-09-21T14:01:46.723228+0000","last_fullsized":"2024-09-21T14:01:46.723228+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2609","last_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_deep_scrub":"180'2609","last_deep_scrub_stamp":"2024-09-21T14:01:46.723118+0000","last_clean_scrub_stamp":"2024-09-21T14:01:46.723118+0000","objects_scrubbed":21,"log_size":2609,"log_dups_size":0,"ondisk_log_size":2609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:44:00.977788+0000","scrub_duration":0.053443966000000002,"objects_trimmed":0,"snaptrim_duration":0.0021057049999999998,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":31522,"num_read_kb":40652,"num_write":4281,"num_write_kb":13681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":480,"num_bytes_recovered":21828584,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.512801+0000","last_change":"2024-09-21T14:01:47.513023+0000","last_active":"2024-09-21T14:01:47.512801+0000","last_peered":"2024-09-21T14:01:47.512801+0000","last_clean":"2024-09-21T14:01:47.512801+0000","last_became_active":"2024-09-21T14:01:17.196481+0000","last_became_peered":"2024-09-21T14:01:17.196481+0000","last_unstale":"2024-09-21T14:01:47.512801+0000","last_undegraded":"2024-09-21T14:01:47.512801+0000","last_fullsized":"2024-09-21T14:01:47.512801+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:01:47.512730+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.512730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:28.118655+0000","scrub_duration":0.0028144400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"180'658","reported_seq":5289,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:43.256499+0000","last_change":"2024-09-21T14:01:43.256499+0000","last_active":"2024-09-21T14:01:43.256499+0000","last_peered":"2024-09-21T14:01:43.256499+0000","last_clean":"2024-09-21T14:01:43.256499+0000","last_became_active":"2024-09-21T14:00:23.173712+0000","last_became_peered":"2024-09-21T14:00:23.173712+0000","last_unstale":"2024-09-21T14:01:43.256499+0000","last_undegraded":"2024-09-21T14:01:43.256499+0000","last_fullsized":"2024-09-21T14:01:43.256499+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'658","last_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_deep_scrub":"180'658","last_deep_scrub_stamp":"2024-09-21T14:01:43.256328+0000","last_clean_scrub_stamp":"2024-09-21T14:01:43.256328+0000","objects_scrubbed":15,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:36:15.672081+0000","scrub_duration":0.016808792999999999,"objects_trimmed":0,"snaptrim_duration":0.0028216000000000001,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":6395,"num_read_kb":28789,"num_write":698,"num_write_kb":24584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":42074174,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:16.903325+0000","last_change":"2024-09-21T14:02:16.903551+0000","last_active":"2024-09-21T14:02:16.903325+0000","last_peered":"2024-09-21T14:02:16.903325+0000","last_clean":"2024-09-21T14:02:16.903325+0000","last_became_active":"2024-09-21T14:01:28.606381+0000","last_became_peered":"2024-09-21T14:01:28.606381+0000","last_unstale":"2024-09-21T14:02:16.903325+0000","last_undegraded":"2024-09-21T14:02:16.903325+0000","last_fullsized":"2024-09-21T14:02:16.903325+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T14:02:16.903274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T14:02:16.903274+0000","last_clean_scrub_stamp":"2024-09-21T14:02:16.903274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T20:14:52.129585+0000","scrub_duration":0.003394799,"objects_trimmed":0,"snaptrim_duration":0.00075557700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"180'588","reported_seq":20188,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.816927+0000","last_change":"2024-09-21T14:01:48.817199+0000","last_active":"2024-09-21T14:01:48.816927+0000","last_peered":"2024-09-21T14:01:48.816927+0000","last_clean":"2024-09-21T14:01:48.816927+0000","last_became_active":"2024-09-21T14:01:16.404261+0000","last_became_peered":"2024-09-21T14:01:16.404261+0000","last_unstale":"2024-09-21T14:01:48.816927+0000","last_undegraded":"2024-09-21T14:01:48.816927+0000","last_fullsized":"2024-09-21T14:01:48.816927+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'588","last_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_deep_scrub":"180'588","last_deep_scrub_stamp":"2024-09-21T14:01:48.816853+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.816853+0000","objects_scrubbed":21,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:40:26.788018+0000","scrub_duration":0.030963671000000002,"objects_trimmed":0,"snaptrim_duration":0.0013920429999999999,"stat_sum":{"num_bytes":0,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":21,"num_read":21428,"num_read_kb":67147,"num_write":571,"num_write_kb":24431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11671184,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"180'2","reported_seq":224,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:47.761874+0000","last_change":"2024-09-21T14:01:47.761874+0000","last_active":"2024-09-21T14:01:47.761874+0000","last_peered":"2024-09-21T14:01:47.761874+0000","last_clean":"2024-09-21T14:01:47.761874+0000","last_became_active":"2024-09-21T14:01:17.204397+0000","last_became_peered":"2024-09-21T14:01:17.204397+0000","last_unstale":"2024-09-21T14:01:47.761874+0000","last_undegraded":"2024-09-21T14:01:47.761874+0000","last_fullsized":"2024-09-21T14:01:47.761874+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'2","last_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_deep_scrub":"180'2","last_deep_scrub_stamp":"2024-09-21T14:01:47.761603+0000","last_clean_scrub_stamp":"2024-09-21T14:01:47.761603+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T19:06:41.636595+0000","scrub_duration":0.0057674420000000002,"objects_trimmed":0,"snaptrim_duration":0.00061736500000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"180'119","reported_seq":312,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:58.865787+0000","last_change":"2024-09-21T14:01:58.865787+0000","last_active":"2024-09-21T14:01:58.865787+0000","last_peered":"2024-09-21T14:01:58.865787+0000","last_clean":"2024-09-21T14:01:58.865787+0000","last_became_active":"2024-09-21T14:00:22.182740+0000","last_became_peered":"2024-09-21T14:00:22.182740+0000","last_unstale":"2024-09-21T14:01:58.865787+0000","last_undegraded":"2024-09-21T14:01:58.865787+0000","last_fullsized":"2024-09-21T14:01:58.865787+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'119","last_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_deep_scrub":"180'119","last_deep_scrub_stamp":"2024-09-21T14:01:58.865623+0000","last_clean_scrub_stamp":"2024-09-21T14:01:58.865623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:35:25.334431+0000","scrub_duration":0.0077650449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"180'513","reported_seq":3594,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:55.976923+0000","last_change":"2024-09-21T14:01:55.977149+0000","last_active":"2024-09-21T14:01:55.976923+0000","last_peered":"2024-09-21T14:01:55.976923+0000","last_clean":"2024-09-21T14:01:55.976923+0000","last_became_active":"2024-09-21T14:01:18.202048+0000","last_became_peered":"2024-09-21T14:01:18.202048+0000","last_unstale":"2024-09-21T14:01:55.976923+0000","last_undegraded":"2024-09-21T14:01:55.976923+0000","last_fullsized":"2024-09-21T14:01:55.976923+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'513","last_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_deep_scrub":"180'513","last_deep_scrub_stamp":"2024-09-21T14:01:55.976864+0000","last_clean_scrub_stamp":"2024-09-21T14:01:55.976864+0000","objects_scrubbed":17,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:01.102938+0000","scrub_duration":0.02808488,"objects_trimmed":0,"snaptrim_duration":0.0017712750000000001,"stat_sum":{"num_bytes":0,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":17,"num_read":3693,"num_read_kb":12236,"num_write":439,"num_write_kb":7949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":338,"num_bytes_recovered":6262373,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"180'440","reported_seq":2916,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.171810+0000","last_change":"2024-09-21T14:01:49.171810+0000","last_active":"2024-09-21T14:01:49.171810+0000","last_peered":"2024-09-21T14:01:49.171810+0000","last_clean":"2024-09-21T14:01:49.171810+0000","last_became_active":"2024-09-21T14:01:20.205074+0000","last_became_peered":"2024-09-21T14:01:20.205074+0000","last_unstale":"2024-09-21T14:01:49.171810+0000","last_undegraded":"2024-09-21T14:01:49.171810+0000","last_fullsized":"2024-09-21T14:01:49.171810+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'440","last_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_deep_scrub":"180'440","last_deep_scrub_stamp":"2024-09-21T14:01:49.171491+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.171491+0000","objects_scrubbed":13,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:00:39.900224+0000","scrub_duration":0.020734200000000001,"objects_trimmed":0,"snaptrim_duration":0.003356688,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":3442,"num_read_kb":20148,"num_write":354,"num_write_kb":15794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":10728966,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"180'808","reported_seq":17028,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:50.661094+0000","last_change":"2024-09-21T14:01:50.661094+0000","last_active":"2024-09-21T14:01:50.661094+0000","last_peered":"2024-09-21T14:01:50.661094+0000","last_clean":"2024-09-21T14:01:50.661094+0000","last_became_active":"2024-09-21T13:58:21.665320+0000","last_became_peered":"2024-09-21T13:58:21.665320+0000","last_unstale":"2024-09-21T14:01:50.661094+0000","last_undegraded":"2024-09-21T14:01:50.661094+0000","last_fullsized":"2024-09-21T14:01:50.661094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'808","last_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_deep_scrub":"180'808","last_deep_scrub_stamp":"2024-09-21T14:01:50.660835+0000","last_clean_scrub_stamp":"2024-09-21T14:01:50.660835+0000","objects_scrubbed":28,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:13:06.622117+0000","scrub_duration":0.050819949000000003,"objects_trimmed":0,"snaptrim_duration":0.00093693499999999996,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":27,"num_read":19781,"num_read_kb":33575,"num_write":862,"num_write_kb":20242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"180'584","reported_seq":4012,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.820758+0000","last_change":"2024-09-21T14:01:49.821009+0000","last_active":"2024-09-21T14:01:49.820758+0000","last_peered":"2024-09-21T14:01:49.820758+0000","last_clean":"2024-09-21T14:01:49.820758+0000","last_became_active":"2024-09-21T14:01:16.404225+0000","last_became_peered":"2024-09-21T14:01:16.404225+0000","last_unstale":"2024-09-21T14:01:49.820758+0000","last_undegraded":"2024-09-21T14:01:49.820758+0000","last_fullsized":"2024-09-21T14:01:49.820758+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'584","last_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_deep_scrub":"180'584","last_deep_scrub_stamp":"2024-09-21T14:01:49.820705+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.820705+0000","objects_scrubbed":16,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:29.221232+0000","scrub_duration":0.028617111000000001,"objects_trimmed":0,"snaptrim_duration":0.0038629490000000001,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":3765,"num_read_kb":20392,"num_write":597,"num_write_kb":22660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":472,"num_bytes_recovered":27546442,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"180'575","reported_seq":4241,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:56.801657+0000","last_change":"2024-09-21T14:01:56.801780+0000","last_active":"2024-09-21T14:01:56.801657+0000","last_peered":"2024-09-21T14:01:56.801657+0000","last_clean":"2024-09-21T14:01:56.801657+0000","last_became_active":"2024-09-21T14:01:17.199567+0000","last_became_peered":"2024-09-21T14:01:17.199567+0000","last_unstale":"2024-09-21T14:01:56.801657+0000","last_undegraded":"2024-09-21T14:01:56.801657+0000","last_fullsized":"2024-09-21T14:01:56.801657+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'575","last_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_deep_scrub":"180'575","last_deep_scrub_stamp":"2024-09-21T14:01:56.801631+0000","last_clean_scrub_stamp":"2024-09-21T14:01:56.801631+0000","objects_scrubbed":19,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T21:56:00.843359+0000","scrub_duration":0.026441732999999999,"objects_trimmed":0,"snaptrim_duration":0.0022174400000000002,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3943,"num_read_kb":19379,"num_write":661,"num_write_kb":12193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":226,"num_bytes_recovered":1547296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"180'458","reported_seq":5023,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:29.893095+0000","last_change":"2024-09-21T14:02:29.893333+0000","last_active":"2024-09-21T14:02:29.893095+0000","last_peered":"2024-09-21T14:02:29.893095+0000","last_clean":"2024-09-21T14:02:29.893095+0000","last_became_active":"2024-09-21T14:01:28.519966+0000","last_became_peered":"2024-09-21T14:01:28.519966+0000","last_unstale":"2024-09-21T14:02:29.893095+0000","last_undegraded":"2024-09-21T14:02:29.893095+0000","last_fullsized":"2024-09-21T14:02:29.893095+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'458","last_scrub_stamp":"2024-09-21T14:02:29.893043+0000","last_deep_scrub":"180'458","last_deep_scrub_stamp":"2024-09-21T14:02:29.893043+0000","last_clean_scrub_stamp":"2024-09-21T14:02:29.893043+0000","objects_scrubbed":18,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:53:48.469171+0000","scrub_duration":0.033515538999999997,"objects_trimmed":0,"snaptrim_duration":0.002931496,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4817,"num_read_kb":30845,"num_write":598,"num_write_kb":19856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":15547519,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"180'583","reported_seq":8010,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:01.913882+0000","last_change":"2024-09-21T14:02:01.913882+0000","last_active":"2024-09-21T14:02:01.913882+0000","last_peered":"2024-09-21T14:02:01.913882+0000","last_clean":"2024-09-21T14:02:01.913882+0000","last_became_active":"2024-09-21T14:00:06.191611+0000","last_became_peered":"2024-09-21T14:00:06.191611+0000","last_unstale":"2024-09-21T14:02:01.913882+0000","last_undegraded":"2024-09-21T14:02:01.913882+0000","last_fullsized":"2024-09-21T14:02:01.913882+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'583","last_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_deep_scrub":"180'583","last_deep_scrub_stamp":"2024-09-21T14:02:01.913534+0000","last_clean_scrub_stamp":"2024-09-21T14:02:01.913534+0000","objects_scrubbed":15,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:16:30.074136+0000","scrub_duration":0.027399421,"objects_trimmed":0,"snaptrim_duration":0.001870977,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":15,"num_read":8179,"num_read_kb":29145,"num_write":569,"num_write_kb":11940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":92,"num_bytes_recovered":8866615,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"180'684","reported_seq":5635,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:08.867219+0000","last_change":"2024-09-21T14:02:08.867219+0000","last_active":"2024-09-21T14:02:08.867219+0000","last_peered":"2024-09-21T14:02:08.867219+0000","last_clean":"2024-09-21T14:02:08.867219+0000","last_became_active":"2024-09-21T14:00:06.192119+0000","last_became_peered":"2024-09-21T14:00:06.192119+0000","last_unstale":"2024-09-21T14:02:08.867219+0000","last_undegraded":"2024-09-21T14:02:08.867219+0000","last_fullsized":"2024-09-21T14:02:08.867219+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'684","last_scrub_stamp":"2024-09-21T14:02:08.866937+0000","last_deep_scrub":"180'684","last_deep_scrub_stamp":"2024-09-21T14:02:08.866937+0000","last_clean_scrub_stamp":"2024-09-21T14:02:08.866937+0000","objects_scrubbed":12,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-23T01:22:54.444965+0000","scrub_duration":0.023418060000000001,"objects_trimmed":0,"snaptrim_duration":0.0025753350000000002,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":12,"num_read":6747,"num_read_kb":26827,"num_write":740,"num_write_kb":15597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":10853679,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"180'672","reported_seq":4887,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:49.643167+0000","last_change":"2024-09-21T14:01:49.643400+0000","last_active":"2024-09-21T14:01:49.643167+0000","last_peered":"2024-09-21T14:01:49.643167+0000","last_clean":"2024-09-21T14:01:49.643167+0000","last_became_active":"2024-09-21T14:00:22.185217+0000","last_became_peered":"2024-09-21T14:00:22.185217+0000","last_unstale":"2024-09-21T14:01:49.643167+0000","last_undegraded":"2024-09-21T14:01:49.643167+0000","last_fullsized":"2024-09-21T14:01:49.643167+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'672","last_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_deep_scrub":"180'672","last_deep_scrub_stamp":"2024-09-21T14:01:49.643110+0000","last_clean_scrub_stamp":"2024-09-21T14:01:49.643110+0000","objects_scrubbed":18,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:36:49.695799+0000","scrub_duration":0.028678182999999999,"objects_trimmed":0,"snaptrim_duration":0.00095790600000000001,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":4615,"num_read_kb":32630,"num_write":646,"num_write_kb":19141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":255,"num_bytes_recovered":31639048,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"180'343","reported_seq":4106,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:10.943795+0000","last_change":"2024-09-21T14:02:10.943795+0000","last_active":"2024-09-21T14:02:10.943795+0000","last_peered":"2024-09-21T14:02:10.943795+0000","last_clean":"2024-09-21T14:02:10.943795+0000","last_became_active":"2024-09-21T14:01:28.519962+0000","last_became_peered":"2024-09-21T14:01:28.519962+0000","last_unstale":"2024-09-21T14:02:10.943795+0000","last_undegraded":"2024-09-21T14:02:10.943795+0000","last_fullsized":"2024-09-21T14:02:10.943795+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'343","last_scrub_stamp":"2024-09-21T14:02:10.943444+0000","last_deep_scrub":"180'343","last_deep_scrub_stamp":"2024-09-21T14:02:10.943444+0000","last_clean_scrub_stamp":"2024-09-21T14:02:10.943444+0000","objects_scrubbed":19,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:26:06.606959+0000","scrub_duration":0.030481133000000001,"objects_trimmed":0,"snaptrim_duration":0.00149303,"stat_sum":{"num_bytes":0,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":19,"num_read":3515,"num_read_kb":29157,"num_write":271,"num_write_kb":13643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":8450501,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"180'1019","reported_seq":5022,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:01:48.213291+0000","last_change":"2024-09-21T14:01:48.213291+0000","last_active":"2024-09-21T14:01:48.213291+0000","last_peered":"2024-09-21T14:01:48.213291+0000","last_clean":"2024-09-21T14:01:48.213291+0000","last_became_active":"2024-09-21T14:00:24.180288+0000","last_became_peered":"2024-09-21T14:00:24.180288+0000","last_unstale":"2024-09-21T14:01:48.213291+0000","last_undegraded":"2024-09-21T14:01:48.213291+0000","last_fullsized":"2024-09-21T14:01:48.213291+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'1019","last_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_deep_scrub":"180'1019","last_deep_scrub_stamp":"2024-09-21T14:01:48.212975+0000","last_clean_scrub_stamp":"2024-09-21T14:01:48.212975+0000","objects_scrubbed":16,"log_size":1019,"log_dups_size":0,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T22:55:31.897590+0000","scrub_duration":0.028793046999999999,"objects_trimmed":0,"snaptrim_duration":0.00586463,"stat_sum":{"num_bytes":0,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":16,"num_read":8793,"num_read_kb":28833,"num_write":1500,"num_write_kb":24357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":268,"num_bytes_recovered":49192435,"num_keys_recovered":95,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"180'429","reported_seq":1705,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-21T14:02:00.902567+0000","last_change":"2024-09-21T14:02:00.902567+0000","last_active":"2024-09-21T14:02:00.902567+0000","last_peered":"2024-09-21T14:02:00.902567+0000","last_clean":"2024-09-21T14:02:00.902567+0000","last_became_active":"2024-09-21T14:00:05.195725+0000","last_became_peered":"2024-09-21T14:00:05.195725+0000","last_unstale":"2024-09-21T14:02:00.902567+0000","last_undegraded":"2024-09-21T14:02:00.902567+0000","last_fullsized":"2024-09-21T14:02:00.902567+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'429","last_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_deep_scrub":"180'429","last_deep_scrub_stamp":"2024-09-21T14:02:00.902263+0000","last_clean_scrub_stamp":"2024-09-21T14:02:00.902263+0000","objects_scrubbed":13,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:36:34.904723+0000","scrub_duration":0.022654962000000001,"objects_trimmed":0,"snaptrim_duration":0.002147066,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":13,"num_read":2196,"num_read_kb":7937,"num_write":341,"num_write_kb":8475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":4940507,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":588,"num_object_clones":0,"num_object_copies":1176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":588,"num_whiteouts":584,"num_read":285515,"num_read_kb":931903,"num_write":24604,"num_write_kb":497187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6844,"num_bytes_recovered":465705111,"num_keys_recovered":533,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0},"log_size":21971,"ondisk_log_size":21971,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":94,"seq":403726925860,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":2700,"kb_used_omap":14,"kb_used_meta":28721,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14458,"internal_metadata":29411206},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84799999999999998,"15min":0.84199999999999997},"min":{"1min":0.50700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.256,"5min":1.468,"15min":1.468},"last":1.054},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.48199999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1120000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.85699999999999998}]},{"osd":1,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.78400000000000003,"15min":0.76700000000000002},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1140000000000001,"5min":1.488,"15min":1.488},"last":1.139},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.82399999999999995,"15min":0.81200000000000006},"min":{"1min":0.61799999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.163,"5min":1.23,"15min":1.23},"last":0.95599999999999996}]},{"osd":2,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.89000000000000001,"15min":0.88200000000000001},"min":{"1min":0.65000000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2010000000000001,"5min":1.514,"15min":1.514},"last":1.0980000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.89500000000000002,"15min":0.89100000000000001},"min":{"1min":0.66400000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3160000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.998,"15min":0.98499999999999999},"min":{"1min":0.72099999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.431,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2}]},{"osd":4,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.91700000000000004,"15min":0.92000000000000004},"min":{"1min":0.57599999999999996,"5min":0.502,"15min":0.502},"max":{"1min":1.246,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.61199999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.97599999999999998,"15min":0.97499999999999998},"min":{"1min":0.67400000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.224,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.95999999999999996,"15min":0.95399999999999996},"min":{"1min":0.67800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.3440000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":0.98099999999999998,"15min":0.97199999999999998},"min":{"1min":0.70399999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.0369999999999999,"15min":1.0249999999999999},"min":{"1min":0.65500000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.4079999999999999,"5min":1.508,"15min":1.508},"last":1.0169999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77520,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94294320,"statfs":{"total":96636764160,"available":96557383680,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":77199815},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.755,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.167,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.753,"15min":0.77100000000000002},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.091,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.75700000000000001}]},{"osd":1,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.72999999999999998,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.1279999999999999,"5min":1.268,"15min":1.268},"last":1.026},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.90600000000000003,"15min":0.98499999999999999},"min":{"1min":0.65200000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1679999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86399999999999999,"15min":0.85099999999999998},"min":{"1min":0.72999999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1830000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.86199999999999999,"15min":0.89600000000000002},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.1830000000000001}]},{"osd":3,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.877,"15min":0.89900000000000002},"min":{"1min":0.61599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.133,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.83999999999999997,"15min":0.82399999999999995},"min":{"1min":0.59399999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.337,"5min":1.367,"15min":1.367},"last":0.82899999999999996}]},{"osd":4,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.86199999999999999,"15min":0.878},"min":{"1min":0.628,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.2090000000000001,"5min":1.353,"15min":1.353},"last":1.054},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.94699999999999995,"15min":0.995},"min":{"1min":0.91800000000000004,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2450000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.071}]},{"osd":5,"last update":"Sat Sep 21 14:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.88100000000000001,"15min":0.91900000000000004},"min":{"1min":0.61299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.3959999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.92400000000000004,"15min":0.94999999999999996},"min":{"1min":0.66800000000000004,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.369,"5min":1.403,"15min":1.403},"last":1.1180000000000001}]},{"osd":7,"last update":"Sat Sep 21 14:02:05 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":0.95399999999999996,"15min":0.94199999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.282,"5min":1.484,"15min":1.484},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.018,"5min":1.0940000000000001,"15min":1.107},"min":{"1min":0.56200000000000006,"5min":0.434,"15min":0.434},"max":{"1min":1.3100000000000001,"5min":4.976,"15min":4.976},"last":0.88700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59476,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312364,"statfs":{"total":96636764160,"available":96575860736,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.53600000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1719999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":1.044},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.54100000000000004,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.752}]},{"osd":1,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.78100000000000003,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.21,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.77000000000000002,"15min":0.77700000000000002},"min":{"1min":0.65700000000000003,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0800000000000001,"5min":1.351,"15min":1.351},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.83599999999999997,"15min":0.84399999999999997},"min":{"1min":0.505,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.877,"15min":0.871},"min":{"1min":0.56000000000000005,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.4690000000000001,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":1.028}]},{"osd":3,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.69899999999999995,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.036,"15min":1.1719999999999999},"min":{"1min":0.74399999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.218,"5min":6.1299999999999999,"15min":6.1299999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.59099999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.878,"15min":0.88},"min":{"1min":0.64500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.26,"5min":1.421,"15min":1.421},"last":0.67100000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:02:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.90200000000000002,"15min":0.91100000000000003},"min":{"1min":0.70699999999999996,"5min":0.312,"15min":0.312},"max":{"1min":1.1859999999999999,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.90300000000000002,"15min":0.90700000000000003},"min":{"1min":0.68500000000000005,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.286,"5min":1.696,"15min":1.696},"last":0.78100000000000003}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":0.96099999999999997,"15min":0.94199999999999995},"min":{"1min":0.85199999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.522,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.004},{"interface":"front","average":{"1min":1.099,"5min":0.97899999999999998,"15min":0.95899999999999996},"min":{"1min":0.80700000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6439999999999999,"5min":2.222,"15min":2.222},"last":0.85699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2174976,"data_stored":1042980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.52500000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2470000000000001,"5min":1.274,"15min":1.274},"last":0.996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.84999999999999998,"15min":0.89500000000000002},"min":{"1min":0.65900000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.2050000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.68899999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":1.53,"15min":2.306},"min":{"1min":0.48899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.2909999999999999,"5min":39.390000000000001,"15min":39.390000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.80700000000000005,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.2070000000000001,"5min":1.528,"15min":1.528},"last":0.97399999999999998}]},{"osd":2,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.871,"15min":0.872},"min":{"1min":0.64600000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.2989999999999999,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.85899999999999999,"15min":0.872},"min":{"1min":0.67400000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.157,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":1.0189999999999999}]},{"osd":3,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.054,"15min":1.2350000000000001},"min":{"1min":0.81599999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2270000000000001,"5min":8.4450000000000003,"15min":8.4450000000000003},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.74,"15min":2.6890000000000001},"min":{"1min":0.57999999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97799999999999998,"5min":41.155000000000001,"15min":41.155000000000001},"last":0.90900000000000003}]},{"osd":5,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.85199999999999998,"15min":0.88400000000000001},"min":{"1min":0.40400000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.363,"5min":1.476,"15min":1.476},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.998,"15min":1.006},"min":{"1min":0.51800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.958,"5min":2.2559999999999998,"15min":2.2559999999999998},"last":0.93000000000000005}]},{"osd":6,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":1.53,"15min":2.258},"min":{"1min":0.57299999999999995,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.014,"5min":36.741999999999997,"15min":36.741999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.91700000000000004,"15min":0.95099999999999996},"min":{"1min":0.49199999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2430000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":0.72099999999999997}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":0.93400000000000005,"15min":0.90900000000000003},"min":{"1min":0.77700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.3280000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.202,"5min":0.97899999999999998,"15min":0.94199999999999995},"min":{"1min":0.89200000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.6259999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":0.878}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51280,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94320560,"statfs":{"total":96636764160,"available":96584253440,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50330056},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.51100000000000001,"15min":0.48699999999999999},"min":{"1min":0.376,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.88900000000000001,"5min":1.296,"15min":1.296},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.90300000000000002,"5min":1.873,"15min":1.873},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84699999999999998,"15min":0.77700000000000002},"min":{"1min":0.378,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.038,"5min":21.995000000000001,"15min":21.995000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.58099999999999996,"15min":0.53700000000000003},"min":{"1min":0.45600000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.0660000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.0820000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.95399999999999996,"15min":0.88500000000000001},"min":{"1min":0.47299999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.196,"5min":22.109000000000002,"15min":22.109000000000002},"last":0.97099999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":1.0149999999999999,"15min":0.90800000000000003},"min":{"1min":0.60899999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3009999999999999,"5min":22.210999999999999,"15min":22.210999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.90400000000000003,"15min":0.92800000000000005},"min":{"1min":0.77100000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.5209999999999999,"5min":5.5279999999999996,"15min":5.5279999999999996},"last":1.099}]},{"osd":5,"last update":"Sat Sep 21 14:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.89900000000000002,"15min":0.98099999999999998},"min":{"1min":0.62,"5min":0.378,"15min":0.378},"max":{"1min":1.3360000000000001,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.86399999999999999,"15min":0.90000000000000002},"min":{"1min":0.63700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.403,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.91800000000000004}]},{"osd":6,"last update":"Sat Sep 21 14:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.151,"15min":1.087},"min":{"1min":0.75,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7250000000000001,"5min":22.157,"15min":22.157},"last":1.028},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.88100000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.367,"5min":2.641,"15min":2.641},"last":0.86299999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:02 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.91900000000000004,"15min":0.90300000000000002},"min":{"1min":0.65700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.0589999999999999,"5min":0.90700000000000003,"15min":0.88100000000000001},"min":{"1min":0.70599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.996}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41424,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330416,"statfs":{"total":96636764160,"available":96594345984,"internally_reserved":0,"allocated":2170880,"data_stored":1042961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.35399999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.77400000000000002,"5min":3.399,"15min":3.399},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66800000000000004,"15min":0.69299999999999995},"min":{"1min":0.28899999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.93300000000000005,"5min":2.9039999999999999,"15min":2.9039999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.996,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.38800000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1359999999999999,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":0.79700000000000004}]},{"osd":3,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.0800000000000001,"15min":1.3740000000000001},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1739999999999999,"5min":19.757000000000001,"15min":19.757000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.1100000000000001,"15min":1.4319999999999999},"min":{"1min":0.40500000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.0629999999999999,"5min":19.652999999999999,"15min":19.652999999999999},"last":0.74099999999999999}]},{"osd":4,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.90000000000000002,"15min":0.92400000000000004},"min":{"1min":0.63500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.2450000000000001,"5min":1.609,"15min":1.609},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.0620000000000001,"15min":1.224},"min":{"1min":0.62,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.4259999999999999,"5min":8.0730000000000004,"15min":8.0730000000000004},"last":1.0660000000000001}]},{"osd":5,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.876,"15min":0.874},"min":{"1min":0.56799999999999995,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.1240000000000001,"5min":3.4500000000000002,"15min":3.4500000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.89900000000000002,"15min":0.92300000000000004},"min":{"1min":0.73699999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.169,"5min":1.534,"15min":1.534},"last":0.90000000000000002}]},{"osd":6,"last update":"Sat Sep 21 14:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.94599999999999995,"15min":0.96799999999999997},"min":{"1min":0.78300000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5489999999999999,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.77800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.204,"5min":3.5760000000000001,"15min":3.5760000000000001},"last":1.038}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0229999999999999,"15min":1.0269999999999999},"min":{"1min":0.51900000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.6339999999999999,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0049999999999999,"5min":1.0489999999999999,"15min":1.056},"min":{"1min":0.59299999999999997,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2829999999999999,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.089}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41432,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330408,"statfs":{"total":96636764160,"available":96594337792,"internally_reserved":0,"allocated":2179072,"data_stored":1042999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.33300000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.89700000000000002,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.495,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.99199999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.67200000000000004}]},{"osd":2,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.63900000000000001,"15min":0.60699999999999998},"min":{"1min":0.46999999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.67500000000000004,"15min":0.64200000000000002},"min":{"1min":0.53100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":1.379,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":0.90000000000000002}]},{"osd":3,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66200000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.221,"15min":0.221},"max":{"1min":1.714,"5min":2.5939999999999999,"15min":2.5939999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.95399999999999996,"15min":1.288},"min":{"1min":0.46300000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.044,"5min":13.083,"15min":13.083},"last":0.71199999999999997}]},{"osd":4,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.85599999999999998,"15min":0.82099999999999995},"min":{"1min":0.74399999999999999,"5min":0.434,"15min":0.434},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.879,"15min":0.85299999999999998},"min":{"1min":0.71999999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.292,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.85299999999999998,"15min":0.85699999999999998},"min":{"1min":0.80400000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.2589999999999999,"5min":1.732,"15min":1.732},"last":0.876},{"interface":"front","average":{"1min":1.048,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.77400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.095}]},{"osd":6,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.69599999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.286,"5min":1.552,"15min":1.552},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.0489999999999999,"5min":0.96599999999999997,"15min":1.004},"min":{"1min":0.84399999999999997,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.7509999999999999,"5min":2.48,"15min":2.48},"last":1.0089999999999999}]},{"osd":7,"last update":"Sat Sep 21 14:02:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":0.91900000000000004,"15min":0.88700000000000001},"min":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.147},{"interface":"front","average":{"1min":1.036,"5min":0.88600000000000001,"15min":0.86099999999999999},"min":{"1min":0.80300000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.0580000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96148,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94275692,"statfs":{"total":96636764160,"available":96538308608,"internally_reserved":0,"allocated":2764800,"data_stored":1633329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.33400000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":4.3399999999999999,"5min":4.3399999999999999,"15min":4.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65600000000000003,"15min":0.69399999999999995},"min":{"1min":0.35899999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.0600000000000001,"5min":1.206,"15min":1.206},"last":1.0289999999999999}]},{"osd":2,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.70499999999999996,"15min":0.77900000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":4.2869999999999999,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.79200000000000004,"15min":0.97399999999999998},"min":{"1min":0.30299999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.143,"5min":7.1769999999999996,"15min":7.1769999999999996},"last":0.90700000000000003}]},{"osd":3,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83699999999999997,"15min":1.0569999999999999},"min":{"1min":0.53800000000000003,"5min":0.247,"15min":0.247},"max":{"1min":1.0620000000000001,"5min":11.84,"15min":11.84},"last":0.747},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.73499999999999999,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":4.3899999999999997,"5min":4.3899999999999997,"15min":4.3899999999999997},"last":0.69999999999999996}]},{"osd":4,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.875,"15min":0.90700000000000003},"min":{"1min":0.58999999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.2410000000000001,"5min":1.647,"15min":1.647},"last":1.119},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.85199999999999998,"15min":0.88200000000000001},"min":{"1min":0.67900000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.198,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.99399999999999999}]},{"osd":5,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":0.89100000000000001,"15min":0.873},"min":{"1min":0.66400000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":1.093},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.95799999999999996,"15min":1.048},"min":{"1min":0.60299999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.26,"5min":4.3710000000000004,"15min":4.3710000000000004},"last":0.86499999999999999}]},{"osd":6,"last update":"Sat Sep 21 14:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.026,"15min":1.0900000000000001},"min":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.9219999999999997,"5min":4.9219999999999997,"15min":4.9219999999999997},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.629,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":1.175}]},{"osd":7,"last update":"Sat Sep 21 14:02:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.94399999999999995,"15min":0.93200000000000005},"min":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":1.222},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.88400000000000001,"15min":0.872},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.151}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7988,"internal_metadata":0}]}} 2024-09-21T14:02:46.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T14:02:46.914 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T14:02:46.914 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T14:02:46.915 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T14:02:46.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.012 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T14:02:47.013 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T14:02:47.013 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.095 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T14:02:47.095 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T14:02:47.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.184 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T14:02:47.184 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T14:02:47.184 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.278 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T14:02:47.279 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-21T14:02:47.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.361 INFO:tasks.ceph.osd.4:Stopped 2024-09-21T14:02:47.362 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-21T14:02:47.362 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:47.431 INFO:tasks.ceph.osd.5:Stopped 2024-09-21T14:02:47.432 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-21T14:02:47.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-21T14:02:53.534 INFO:tasks.ceph.osd.6:Stopped 2024-09-21T14:02:53.534 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-21T14:02:53.534 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.616 INFO:tasks.ceph.osd.7:Stopped 2024-09-21T14:02:53.616 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T14:02:53.616 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-21T14:02:53.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.655 INFO:tasks.ceph.mgr.y:Stopped 2024-09-21T14:02:53.656 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T14:02:53.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.686 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T14:02:53.686 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T14:02:53.687 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T14:02:53.687 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.700 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T14:02:53.700 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-21T14:02:53.700 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.755 INFO:tasks.ceph.mon.c:Stopped 2024-09-21T14:02:53.756 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-21T14:02:53.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T14:02:53.775 INFO:tasks.ceph.mon.b:Stopped 2024-09-21T14:02:53.775 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T14:02:53.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-09-21T14:02:53.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T14:02:53.815 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T14:02:54.122 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T14:02:54.122 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T14:02:54.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T14:02:54.352 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T14:02:54.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T14:02:54.545 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T14:02:54.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T14:02:54.738 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-21T14:02:55.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T14:02:55.036 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-21T14:02:55.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T14:02:55.244 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-21T14:02:55.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T14:02:55.428 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-21T14:02:55.604 INFO:tasks.ceph:Archiving mon data... 2024-09-21T14:02:55.605 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/data/mon.a.tgz 2024-09-21T14:02:55.605 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-21T14:02:55.611 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.8RDIyyjRaR 2024-09-21T14:02:55.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8RDIyyjRaR 2024-09-21T14:02:55.767 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.8RDIyyjRaR 2024-09-21T14:02:55.831 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.8RDIyyjRaR is 435KB 2024-09-21T14:02:55.893 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.8RDIyyjRaR 2024-09-21T14:02:55.898 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/data/mon.c.tgz 2024-09-21T14:02:55.898 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-21T14:02:55.948 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.JyOUBNob3G 2024-09-21T14:02:55.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.JyOUBNob3G 2024-09-21T14:02:56.130 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.JyOUBNob3G 2024-09-21T14:02:56.195 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.JyOUBNob3G is 590KB 2024-09-21T14:02:56.257 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.JyOUBNob3G 2024-09-21T14:02:56.262 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/data/mon.b.tgz 2024-09-21T14:02:56.263 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-21T14:02:56.269 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.b7jixkzo0b 2024-09-21T14:02:56.269 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.b7jixkzo0b 2024-09-21T14:02:56.452 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.b7jixkzo0b 2024-09-21T14:02:56.512 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.b7jixkzo0b is 590KB 2024-09-21T14:02:56.579 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.b7jixkzo0b 2024-09-21T14:02:56.584 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T14:02:56.584 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T14:02:56.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T14:02:56.640 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-21T14:02:56.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-21T14:02:56.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-21T14:02:56.667 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-21T14:02:56.712 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-21T14:02:56.716 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T14:02:56.717 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi079/crash 2024-09-21T14:02:56.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T14:02:56.730 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi134/crash 2024-09-21T14:02:56.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T14:02:56.771 INFO:tasks.ceph:Compressing logs... 2024-09-21T14:02:56.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T14:02:56.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T14:02:58.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-21T14:03:11.990 INFO:tasks.ceph:Archiving logs... 2024-09-21T14:03:11.990 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi079/log 2024-09-21T14:03:11.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T14:03:13.441 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi134/log 2024-09-21T14:03:13.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T14:03:14.670 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T14:03:14.678 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T14:03:14.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T14:03:14.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T14:03:14.756 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T14:03:14.765 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T14:03:14.765 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T14:03:14.767 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T14:03:14.778 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T14:03:14.779 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-21T14:03:14.779 INFO:teuthology.orchestra.run.smithi079.stdout:*hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.104 -1.892 0.742 2024-09-21T14:03:14.779 INFO:teuthology.orchestra.run.smithi079.stdout:+hv02.front.sepi 96.245.170.99 3 u 65 64 177 0.110 +1.695 0.845 2024-09-21T14:03:14.779 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 66 64 177 0.112 -2.351 0.543 2024-09-21T14:03:14.779 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout:*hv01.front.sepi 67.205.162.81 3 u 66 64 177 0.074 -2.608 1.345 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout:+hv02.front.sepi 96.245.170.99 3 u 4 64 377 0.084 +1.253 0.930 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.088 -1.455 1.679 2024-09-21T14:03:14.782 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-21T14:03:14.783 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T14:03:14.792 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T14:03:14.792 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T14:03:14.801 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T14:03:14.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T14:03:14.818 INFO:teuthology.task.internal:Duration was 919.069419 seconds 2024-09-21T14:03:14.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T14:03:14.864 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T14:03:14.864 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T14:03:14.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T14:03:14.904 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T14:03:14.904 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T14:03:14.904 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T14:03:14.952 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-21T14:03:14.952 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T14:03:14.962 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T14:03:14.962 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T14:03:14.996 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T14:03:15.032 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T14:03:15.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T14:03:15.072 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T14:03:15.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T14:03:15.152 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T14:03:15.152 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T14:03:15.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T14:03:15.175 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T14:03:15.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T14:03:15.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T14:03:15.215 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-21T14:03:15.224 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-21T14:03:15.320 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T14:03:15.324 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T14:03:15.326 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T14:03:15.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T14:03:15.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T14:03:15.381 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T14:03:15.381 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi079 2024-09-21T14:03:15.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T14:03:15.408 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_22:16:03-rbd-reef-distro-default-smithi/7909900/remote/smithi134 2024-09-21T14:03:15.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T14:03:15.432 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T14:03:15.432 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T14:03:15.444 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T14:03:15.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T14:03:15.487 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T14:03:15.487 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T14:03:15.496 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T14:03:15.496 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T14:03:15.499 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T14:03:15.502 INFO:teuthology.orchestra.run.smithi079.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 14:03 /home/ubuntu/cephtest 2024-09-21T14:03:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 14:03 /home/ubuntu/cephtest 2024-09-21T14:03:15.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T14:03:15.537 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T14:03:15.559 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} duration: 919.0694191455841 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-21T14:03:15.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T14:03:15.649 INFO:teuthology.run:pass